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Abstract 


The  problem  of  data  fusion  fs  In  a  real  sense  the 
problem  of  how  to  model  the  real  world  with  all  of  Its 
great  complexities.  A  miniaturized  version  of  this  Is 
the  multiple  target  tracking  and  data  association  prob¬ 
lem.  There, a  number  of  pieces  of  Information  arrive, 
typically  from  disparate  sources  -  such  as  from  various 
sensing  system  and  from  human  sources  In  the  form  of 
narrative  descriptions  in  natural  language.  A  procedure 
has  already  been  established  for  dealing  with  this  type 
of  situation,  called  succinctly  the  PACT  algorithm. 
(PACT  -  Posslbil Is  tic  Approach  to  Correlation  and 
Tracking.)  The  technique  Is  based  upon  the  premise 
that  all  arriving  information  can  be  adequately  treat¬ 
ed  through  some  appropriate  choice  of  classical  or 
multivalued  logic  such  as  Probability  Logic,  Fuzzy 
Logic,  lukaslewIcz-Mr  Logic,  or  some(t-norm,  t-conorm, 
negation  functionJgeAeral  logic  as  discussed  In  a 
recent  text  of  Goodman  and  Rguyen,  Uncertainty  Node Is 
for  Knowledge- based  Systems .  Moreover,  ft  can  be  dea^ 
onstrated  thatfora  large  class  of  logics  chosen, 
a  version  of  a  partially  specified  Probability  Logic 
may  he  used  instead.  Indeed,  other  approaches  to  un¬ 
certainty.  such  as  the  Dempster-Shafer  approach,  can 
also  be  strongly  related  to  Probability  Logic  through 
the  vehicle  of  random  set  modeling.  In  any  case,  the 
structure  of  the  PACT  algorithm  is  based  upon  a  gen¬ 
eralized  chaining  and  disjunction  relation,  which  In 
a  classical  probability  setting  reduces  to  the  usual 
posterior  probability  description  as  a  weighted  sum 
of  intermediate  probabilities,  an  alternative  form  of 
Bayes'  formulation.  In  the  PACT  algorithm, joint  In¬ 
ference  rules  are  represented  which  connect  various 
combinations  of  matches  of  the  Intermediate  attri¬ 
butes  relevant  to  correlation  (such  as  geolocation, 
radar  paraamters,  visual  narratives,  etc.)  to  the 
consequential  correlation  levels  between  track  his¬ 
tories.  In  addition,  error  relations  Involving  these 
attributes  are  also  represented. 

In  the  present  paper,  the  PACT  technique  fs  ex¬ 
tended  to  the  full  combination  of  evidence  problem, 
viewed  as  being  identical  to  the  general  data  fusion 
problem.  In  addition,  data  fusion  Is  also  intimately 
linked  with  Internodal  activity  within  a  larger  C3 
system.  Here  such  CJ  systems  are  Identified  as  net¬ 
works  of  Interacting  dec  is on- maker  node  complexes. 

Some  general  examples  of  data  fusion  In  this  context 
are  presented.  Including  a  new  approach  to  the  use 
of  marginal  conditional  probabilities  measuring  valid¬ 
ity  of  Inference  rules  via  "conditional  objects*. 


1.  INTRODUCTION 

For  the  past  several  years,  throughout  many  fields 
of  science  and  technology,  researchers  have  been  seek¬ 
ing  unification  and  extension  of  past  results  in  order 
to  explain  reality  better  and  to  be  able  to  predict 


future  fcve loraier.ts .  Recent  events  In  theoretical 
physics  Involving  “superstrtng"  theory,  an  attempt  at 
developing  a  Grand  Unified  Theory  of  the  Universe, 
underscore  this  quest  [1], 

In  a  more  modest  way,  this  paper  seeks  to  estab¬ 
lish  a  theory  unifying,  coordinating,  and  extending 
the  somewhat  appearing  distinct  concepts  of  data  fus¬ 
ion,  combination  of  evidence,  and  CJ  systems  analysis. 
On  the  other  hand,  relatively  little  attention  will  be 
paid  here  to  detailed  computational  techniques  which 
are  particular  to  certain  types  of  common  data  fusion 
problems  Such  as  regression  procedures  for  combining 
stochastic  sensor  information,  or  maximum  likelihood 
or  Bayesian  procedures  for  putting  together  geoloca¬ 
tion  data  arriving  from  different  sources  relative 
to  a  given  target  of  interest.  All  of  the  above-men¬ 
tioned  techniques  are  essentially  special  cases  of 
a  much  more  general  combination  of  evidence  approach 
on  which  this  paper  will  concentrate. 

In  the  past  there  has  been  much  dispute  as  to 
what  constitutes  data  fusion.  A  rea-.oneble  three-fold 
definition  has  been  proposed  in  [2],  which,  except  for 
a  minor  modification  (as  shown  below),  will  be  the 
basis  for  the  work  here.  In  a  related  vein,  mention 
should  be  made  of  the  recent  (unclassified)  survey  of 
data  fusion  techniques  [3],  The  basic  definition  for 
data  fusion,  for  coaipleteness ,  is  given  below: 

(1)  'The  Integration  of  Information  from  multiple 
sources  to  produce  the  most  comprehensive  and  specific 
unified  data  about  an  entity.* 

(11)  'The  analysis  of  Intelligence  Information  from 
multiple  sources  covering  a  number  of  different  events 
to  produce  a  comprehensive  report  of  activity  that 
assesses  its  significance.  The  analysis  is  often  sup¬ 
ported  by  the  inclusion  of  operational  data.' 

(Hi)  "Intelligence  usage,  the  logical  blending  of 
related  information  /  intelligence  from  multiple  sour¬ 
ces.'  [  "After  fusion,  the  sources  of  the  Inputs  and 
single  pieces  of  information  must  not  be  evident  to 
the  user.'  This  we  believe  to  be  too  restricted,  IRG.3 

One  of  the  most  comnon  examples  of  fusion  of  data 
occurs  in  the  multiple  target-tracking  problem.  Here, 
information  arrives  in  disparate  form.  Typically,  this 
includes  sensor  Information  emanating  from  possibly 
several  different  types  of  sources.  Such  as  radar, 
acoustic,  non-acoustic.  Infra-red,  and  various  others. 
In  addition,  non-mechanical  /  human  sensor  sources 
may  be  present  in  the  form  of  natural  language  narra¬ 
tives  or  descriptions,  possibly  In  a  parsed  form, suit¬ 
able  for  symbolizations .  Much  of  the  arriving  informa¬ 
tion  can  be  related  to  the  targets’  observed  or  pre¬ 
dicted  positions,  velocities,  or  related  equations  of 
notion.  On  the  other  hand,  some  of  the  data  may  refer 
to  other  characteristics  or  attributes  of  the  targets. 
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Examples  of  the  latter  Include:  hull  lengths,  vessel 
shepes,  observed  fltg  colors,  names,  classifications, 
and  other  nan*  geo  locational  sensor  pa  raise  ter  esti¬ 
mates. 

Nevertheless,  as  recently  as  a  few  years  ago,  the 
great  majority  of  approaches  to  target  data  fusion 
were  concerned  only  with  target  positions  and  other 
geolocatlon  data  and  Ignored,  at  least  in  a  formal 
way,  no st  of  the  other  potentially  useful  stochastic 
and  non-stochastic  (such  as  linguistic)  Information. 
For  a  solid  Justification  of  this  conclusion,  see  (4] 
and  [S],  where  a  comprehensive  survey  of  multiple 
target- tracking  techniques  was  carried  out.  For 
comprehensive  mathematical  treatments  of  such  'class¬ 
ical*  data  association  and  correlation,  see  [6] 
e.g.  For  an  exception  to  the  above  statement  con¬ 
cerning  the  restriction  of  fusion  to  geolocatlon-only 
information,  see,  e.g.  [7], [8], [9]. 

However,  with  thr  advent  of  AI  In  the  form  of 
expert  and  knowledge-based  systems.  It  Is  apparent 
that  this  additional  Information  could  be  utilized. 
(See,  e.g.  [10].)  Following  the  lead  of  medical  diag¬ 
nostic  systems  such  as  MYCIN  [11],  many  such  systems 
(not  necessarily  military  oriented)  utilize  only 
two-valued  logic  In  conjunction  with  some  use  of 
probabilities  to  represent  confidences.  On  the  other 
hand,  some  approaches  take  a'softer*  decision  view¬ 
point  as  to  the  nature  of  descriptions  and  employ 
throughout  some  form  of  multivalued  logic  (such  as 
the  PACT  algorithm  [12]). 

Moreover,  data  fusion  Is  Intimately  related  to 
the  functioning  of  C3  systems.  Indeed,  In  many  cases, 
data  fusion  may  be  perceived  as  an  interacting  decis¬ 
ion  process  occurring  within  each  decision-maker 
node  relative  to  the  entire  C3  network  of  nodes. 

Thus,  any  ongoing  work  In  the  CJ  arena,  must  effect 
data  fusion  efforts.  Since  1978,  the  annual  MIT/ONR 
Workshop  on  CJ  Systems  -  with  Its  associated  (un¬ 
classified)  annual  Proceedings  -  has  served  as  one  of 
the  primary  academic  sources  for  generic  C3  studies. 
(See  [13]  for  a  partial  survey  of  these  efforts.  See 
also  [14]  for  a  more  thorough  survey  of  C3  work,  where 
many  abstracts,  analyses,  and  comparisons  and  con¬ 
trasts  of  C3  theories  and  related  work  are  given.) 
Surprisingly,  relatively  few  comprehensive  theories 
of  C3  systems  have  been  produced,  although  many  vaK 
uable  papers  have  been  written  as  a  result  of  the  CJ 
Workshop  on  problems  of  distributive  decision-making, 
hierarchical  systems,  coanxintcatlons  and  security, 
multiple  target-tracking  and  correlation,  and  various 
miscellaneous  game- theore tl c  and  warfare  design  prob¬ 
lems.  Among  the  few  theories  of  CJ  should  be  mentioned 
[41]  and  [42],  the  latter  taking  a  related  vlmi  of  fusion 

Based  upon  the  above  remarks.  It  Is  the  author's 
conclusion  that: 

(1)  Data  fusion, as  coamnnly  applied.  Is  a  process 
occurring  fntranodally  within  the  context  of  an  ap¬ 
propriately  chosen  overall  C3  system.  That  Is, fusion 
occurs  typically  within  decision-making  nodes. 

(2)  All  analysis  and  models  of  C3  systems  must  In¬ 
clude  subanalysis  and  models  for  fusion  processes.  In 
particular,  this  applies  to  this  author's  proposed 
model  for  C3  sj-stem*  [15], [16], 

(3)  Data  fusion  In  Its  most  generic  sense  can  be 
equated  with  the  combination  of  evidence  problem,  a 
well-known  problem  arising  In  the  modeling  of  uncer¬ 
tainties  for  knowledge-based  systems.  (For  further 
elaboration  and  background,  see  [17].) 

2.  DATA  FUSION,  C3  STS TIMS,  AND  DATA  PROCESSING 

Previously,  this  author  proposed  a  bottoms.up, 
microscopic,  quantitative  approach  to  general  CJ  sys¬ 
tems  [IS], [16],  In  that  approach,  a  generic  C3  system 
Is  Identified  as  a  network  of  node  complexes  of  de¬ 


cision-makers,  human  or  automated.  Interfacing  with 
each  other  In  general.  Each  node  receives  “slgnals'- 
whlch  may  be  ordinary  communication  signals,  either 
from  friendly  or  hostile  sources  (possibly  unaware), 
or  which  may  be  received  weapon  fire.  In  general, 
these  "signals'  are  stacked  vectors  comprised  of  In¬ 
coming  data  from  several  different  nodes.  In  turn, 
each  node,  which  nay  consist  of  a  single  decision¬ 
maker  or  some  coalition  of  decision-eaters  ard  which 
may  include  passive  type  decision-makers,  such  as 
'followers'  ,  then  processes  the  data.  This  Is  follow 
ed  by  a  response  or  action  taken  towards  other  nodes, 
friendly  or  hostile.  (See  Figure  1.)  Associated  wl th 


^  INDICATES  INTERVENING  C3  ENVIRONMENT  AFFECTING 

RECEIVED  "SIGNALS”  AND  RESPONSES:  TERRAIN,  WEATHER, 
SECRECY  NEED 

- *  INDICATE  NODE  ACTIVITY  AT  GIVEN  TIME  SLICE: 

RECEIVED  'SIGNAL'  OR  RESPONSE 

Figure  1.  "Signal”  and  Response  Activity  in  a  Portion 
of  Two  CJ  Systems. 
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Figure  2.  Components  of  C  Node  States. 
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each  nod*  1i  the  node  state  (see  Figure  2.)  describing 
the  current  state-of-affairs  given  in  terns  of  a  nun* 
her  of  functions  such  as  threat  level,  equations  of 
notion,  and  supply  level.  In  addition,  there  is  an  as¬ 
sociated  knowledge  base  reflecting  the  node's  local 
knowledge  of  the  other  aodes  (friendly  or  adversary). 
Also  associated  with  each  node  is  Its  internal  "signal'' 
processing  design,  as  described  In  Figure  I.  There, 
data  fusion  plays  a  central  role  In  transnltting  de¬ 
tected  "signals*  to  hypotheses  fomulatlons,  which  In 
turn  through  algorlthn  selection  leads  to  an  output 
response  to  other  nodes  (again,  these  eay  be  friendly 
or  adversary). 

Next,  since  we  identify  data  fusion  with  the  com¬ 
bining  of  evidence,  all  of  the  knowledge-based  system 
techniques  associated  with  the  latter  are  available. 

In  particular,  this  Infers  (see  [17],  Chapters  1,2 
and  Figure  I,  page  14)  that  a  series  of  underlying 
processes  are  Involved  In  data  fusion.  Basically, 
there  are  five  such  processes  (Including  natural 
language  in  Its  broadest  context)  given  below  in  se¬ 
quence  of  information  processing: 

(1)  Cognition:  Human  and/or  machine  in  recognizing 
the  pattern  of  received  "signals’,  recalling  that 
"signals*  refer  to  either  ordinary  signals  or  any 
other  received  Input,  including  weapons  fired. 

(2)  Natural  Language  Formulation:  This  Is  rele¬ 
vant  to  all  narratives  produced  by  himn  observors. 
Machine  language  could  also  be  put  in  this  area,  if 
used  in  the  same  context.  Parsing  leads  to  the  next 
process : 

(3)  Primitive  symbolic  formulation  of  data,  in¬ 

cluding  strings  of  well-formed  formulas  according 
to  basic  syntax,  without  further  or  refined  con¬ 
straints  on  structures.  Formulations  include  use  of 
basic  quantifiers  and  Connectors: •, for  i  ("and"  or 
conjunction):  v.for  "or"  (disjunction);  (  )',  for  "not* 
(negation);  *#for  "If _ then _  *  (implication). 

(4)  Full  formal  language  formulation  of  data:  Use 
of  rules  of  syntijt,  constraints  on  wff's,  such  as 
commutativity,  associativity,  idempotence,  distrib¬ 
ute)  ty, etc. 

(5)  Full  compatible  (homomorphic-like)  semantic 
evaluations  or  logic  chosen  (or  model  selected). 

Any  consistent  or  compatible  choice  of  a  full 
formal  language  (4)  and  a  semantic  evaluation  or 
logic  (5)  we  will  call  an  algebraic  loqic  description 
pair  (ALOP).  - - - 

Three  common  choices  for  ALOP  are: 

ALDP  1  *  (Boolean  algebra(or  ring).  Classical 
ttwo-valuedlLoglc)  with  implication  N 
given  as  ■*  ,  where  B  ■*»  is  identified 
as  )'  v  >  ,  for  all  wff's  «.*. 

ALOP  2  •  (Modified  boolean  algebra  ■  pseudo-comple- 
mented  lattice,  Zadeh’s  (mln-max)  Fuzzy 
Sets  or  Logic).  As  above,  *  ■  ♦  . 

ALOP  3  *  (Boolean  algebra,  Probability  Logic);*  *  •*. 

A  fourth  usefuHConrtltlonal  Probability  logic) 

ALOP  will  be  Introduced  later.  In  the  past,  often  only 
ALOP  1  or  ALOP  3  were  chosen,  In  effect,  to  the  ex¬ 
clusion  of  multivalued  logical  choices.  That  is,  either 
Classical  Logic  or  Probability  Logic, or  some  combina- 
tion, would  be  chosen  for  the  basic  model  to  combine 
information  or  fuse  data,  with  little  attention  paid 
to  the  formal  aspects  prior  to  semantic  evaluations. 
(Again,  see  (4], [5].) 

Figure  4  summarizes  the  above  analysis  of  data 
fusion. 
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Figure  4.  Subprocess  Expansion  of  Data  Fusion/Combination 
of  Evidence  Process  Connecting  Initial  "Signal" 
_ Detections  with  Hypotheses  Formulations, _ 


3.  DATA  FUSION  AS  A  QUANTITATIVE  PART  OF  AN  OVERALL 
C3  SYSTEM  AND  DECISION  GAME 

So  far,  in  this  development  toward  a  general 
theory  for  the  fusion  of  data,  only  general  qualita¬ 
tive  descriptions  have  been  given  for  the  processes 
Involved.  However,  as  mentioned  before,  a  quantita¬ 
tive  nodal  for  generic  C3  systems  has  been  established 
compatible  with  these  qualitative  fornulat1ons[15], 

[16 j .  Inputs  to  the  structure  consist  basically  of 
ten  sorts  of  known  relative  primitive  relations  PRIM 
among  the  variables  describing  a  C3  system.  These  var¬ 
iables  am  inode  (NJdtypotheses  selection  (H);  detection 
(D)  of  incoming  "signals"  (S);  algorithm  selections 
(F);  initial  noee  responses  (R), prior  to  environmental 
distortion  (G)  and  additive  noise  (Q).  To  each  vari¬ 
able  Is  affixed  subscripts  (g,k)  (or  (h.g.k))  where 
g*(a,1)  denotes  the  identification  of  a  particular 
node  in  question  In  terms  of  the  C3  system  a  (friend¬ 
ly  or  hostile)  and  node  number  1,  while  k  represents 
a  discrete  time  index  t. .  Specifically,  the  relation 
breaks  down  Into  S  intrinodal  (within  nodes)  rela¬ 
tions,  2  internodal  (between  nodes)  or  regression  re¬ 
lations,  and  3  prior  relations  for  each  C3  system. 
These  relations  are  expressed  In  terms  of  conditional 
or  unconditional  probabilities,  as  they  stand,  but 
the  resul ts  can  fej  extended,  with  appropriate  replace¬ 
ments,  tn  a  multivalued  logic  settlno.  (Again,  see 
[15].}  Then  by  making  cerUin  reasonable  sufficiency 
assumptions  among  the  variables  and  utilizing  basic 
properties  of  conditional  probabilities,  it  can  be 
shown  that  each  updated  node  state  can  be  obtained 
explicitly  in (probabilistic) terms  of  the  other  vari¬ 
ables  and  node  states  through  PRIM.  Thus,  we  have: 
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Thenr—  1.  (See  [IS],  Theorem  1.] 

Suppose  PRIM^  and  Ng  k  *r«  as  described  above 

with  PRIR  given  In  further  details  in  eqs.  (3.2)- 
(3.4)  and  Tables  1*3.  Then  under  the  above-mentioned 
sufficiency  conditions, 

P(V5  *  Vk(p,IV  ■  (3'1) 

where  ♦  k  Is  a  computable  functional  Involving  a  fi¬ 
nite  number  of  Integrations  and  arithmetic  operations 
upon  the  elements  of  PRIM.,  given  In  Table  4. 

*  ■ 

PRIM)i  •  (PRtM^,'1,.PRII4[1,2,;PRI(^2))  .  (3.2) 

where  for  C3  system  a,  g-(a.l),  etc., 

NM[’**><((1)  e  ....»)  a  .(•la.(l«)t.^,11  a.h. 

1  1  ir  <h 


and  whtrt 


The  numerical  symbols  (5).  k  etc.  arc  shortened  forms 
for  the  primitive  relations  given  In  Tables  1-3: 


(,)g.h  * 

P(H9.h|09.h 

(2V  * 

p(Fg.k,Hg.k1 

1  . 

(3,g.kfi* 

P<WF9, 

■  h-S 

(4,9.h>l‘ 

p(Ng.k+i'Rg, 

ik+l 

(5)9.h  * 

p{09.k|S9.k' 

’*9 

Table  1.  Relative  Primitive  Intranodal  Relations. 


(61h.g.h*1  *  p(Qh,g,k*l>  **«•  S.g.ktr 

(?lh,g,k+l  '  P^g.kt]  -hlh0); 

The  basic  intemodal  analysis  Is  developed  via 
addtive  nonlinear  regression  relation 

(SJ.^“'9.kfl-<^k))*S,g.k.ltph,k^h,g.hvl. 

where  variable  Ug  k+1  indicates  original  possible 

possible  node  source  for  'signal’  at  time  k,  given 
reception  by  another  node  at  k+1 . 

Table  2.  Relative  Primitive  Intemodal  Relations. 


{91g,k+l*p(Rg,k+l!0g.k*Sg,k*N9.k) 

-//  OW^g.k-^g.fl^S.k^g.k  * 

fover  all  F^.k.Hg.k) 

(10,g.k+l  *  ptNg.k+|lDg,k*Sg>k,Ng,k) 

‘fovfr  l?iVk+l‘(9,9'k+l  ' 


/over  a  IT?’ 
V  R9.h»l) 


(11}g,k+l  '  p{Rg.k*llSg,k'Hg,k} 

%  V^W^g.k’  * 

9.* 

(12)g.k+l  *  p(Ng.krl,Dg.klSg,k'Ng,k) 

’  ('0)9.W(S)9.k  * 

03)9.fl  ■1P(N3.MllSg.k-''g.k) 

9.* 

(1<’h,g,k+r  p^Sg,k+llRh,k* 

*  p(Qn,g,k*l'S9.h'H*Gh.g.k*l(Rh1k))> 
^h.g.k  ‘  p(Rh.klK0-“g,k*rhJ 

//f1,lh,k,('Vr|,,|n1W  dSh.k-l  dNi>, 

h.t-1,Hn.h-l) 

’g.k  *  p(Sg,klV 

,{r{l,(1?)h.9.h-(,5>h,,,k.r(7,h,g.k-,  dh  dRh 
h,Rh,k-l) 

'g,k+l  ‘  p(Kg,krl,Hg,k,N0) 

fover  ain  9.1  9.1 

\  S9.1  ) 

).  ,  '  P(H_  JhJ.  /  (17)  -(18).  t  ,  dh_ 

$ 


over  all 


Table  4.  Structure  of  V.  ,,  In  Theorem  1  Through 
9.1 

Sequence  of  Calculations  Involving  PRIMk 


PRIOR/IHITIAL  TIME 
(8)<,  •  p(N„)  , 

(15)h,g.O  ’  p‘Rh,ol“g.rh  •  V. 
n«),.0  •  p(s9>0|r0)  . 

Table  3.  Relative  Primitive  Prlor/Inltlal  Relations 


In  turn,  t  simple  two-person  zero  sum  game  can 
be  established,  called  the  C3  dec  is  Ion  game.  Mere, 
Player  I  corresponds  to  entire  C3  system  a-1  (say, 
friendly)  and  Player  II  corresponds  to  entire  C^sys- 
tem  a*2  (say,  adversary).  In  this  game,  a  move  by 
Player  j  corresponds  to  a  choice  (up  to  given  con¬ 
straints)  of  PRIhjl. J),  J-I.II,  and  the  resulting 
loss  or  utility  due  to  any  such  joint  move  lk  Is  a 
funetton  of  the  marginal  updated  node  state  distri¬ 
butions,  according  to  Theorem  1  as 

Lk(PRIKk).MOEk(lp(NI(([)|all  g)) 
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•  HOEk(Wg  k(PRIMk)|iU  9}).  (3.5) 


uhere  HOC.  represents  a  single  flgure-of-merlt,  com- 
blnlng  venous  measures  of  effectiveness  (moe's)  or 
performance  (mop's)  for  the  too  C3  systems.  (Note,  that 
although  Ideally  the  entire  Joint  node  state  dlstrl- 
button  of  the  two  C3  systems  should  be  sought,  In 
practice  this  Is  difficult  to  do,  because  of  the  great 
combinatoric  computations  Involved.)  Typical  moe's 
that  could  be  used  Include: averaged  measure  of  Import¬ 
ance  TIT  .  ;  averaged  m easure  of  threat  TTT  ;  upper 

bound  total  entropy  ENT  .  ;  and  averaged  measure  of 
performance  ACC  .  .  all  computable  through  p(N  , )‘s 

for  C  system  a,  by  use  of  Theorem  1.  (See  also  [15], 
eqs.(b 9)-(6d).)  Then  one  could  let 


HOC,  -  H0E1#k  -  H0£2fk  . 


(3.6) 


where 


"°£.,k  *  V^.k  *  Y^.k  +  V^a.k 


+  V*CC,.k  . 


(3.7) 


and  the  A.'s  are  some  predetermined  weightings. 

1  3 

Symbolically,  the  C  decision  game  appears  as 
given  In  Figure  5: _ 


\  Player  1  (Friendly  C  Syi 
Player  II  A  Typical  Hove:  PRI»1.,J 
(Adversary  CJ  ) - ? - 


stem) 


[(Adversary 
System) 

iTypIcal  Hove: 

prihP,z^ 


i 


-f  Loss*  Lk(PRIHk) 


Figure  5.  Symbolic  Form  for  CJ  Decision  Same. 


Finally,  one  can  then  apply  all  the  usual  game- 
theoretic  methods  to  this  CJ  game.  Such  as  seeking 
Bayes  decision  functions  for  moves,  least  favorable 
strategies  (all  subject  to  practical  constraints), 
alnlmax  strategies,  the  game  value,  and  various  sensi¬ 
tivity  measures.  It  Is  the  long-range  hope  that  such 
a  game  will  be  a  useful  decision-aid  In  planning  com¬ 
mand  strategy.  At  present,  a  relatively  simple  imple¬ 
mentation  scheme  Is  being  carried  out  for  testing  the 
feasibility  of  such  an  approach  to  CJ  systems.  (See 
[16]  for  further  details.) 


4.  STRUCTURE  FOR  DATA  FUSION:  THE  CLASSICAL 
PROBABILITY  CASE 

Mlth  the  general  C2  system  context  for  data 
fusion  established  In  the  previous  sections,  let  us 
now  return  to  the  task  of  developing  a  general  quanti¬ 
tative  structure  for  data  fusion.  In  light  of  the  pre¬ 
vious  remarks  (again,  see  Figure  3),  fusion  Is  a  pro¬ 
cess  Intermediate  with  Initial  sensing  and  hypotheses 
formulations,  within  a  CJ  node  complex  of  decision¬ 
makers.  In  addition,  the  fusion  process  decomposes  In¬ 
to  natural  subprocesses  (see  Figure  4).  Thus,  In 
essence,  we  wish  to  expand  the  first  relative  primi¬ 
tive  Intranodal  relation  appearing  In  Table  1  : 


fable  Z  Is  often  present.  Z  represents  the  rector  of 
auxiliary  or  "nuisance"  characteristics  or  attributes 
which  can  be  useful  In  connecting  H,  the  variable  rep¬ 
resenting  possible  hypotheses  or  decisions  as  to  what 
unknown  parameter  value  or  situation  or  diagnosis  Is 
occurring,  with  Input  data  S  and  detection  state  0. 
Thus  for  example.  If  we  are  physically  In  a  bunker- 
a  C 3  node-  S  may  be  observed  loud  noise,  with  0*1 
(definitely  detected),  and  H  could  have  possible  do¬ 
main  values  say  dom(H)*(Hj , . . ,Hj)  as  given  in  Table  5. 


Kj  ■  no  change  In  previous  situation 

H,  ■  enemy  Is  about  to  mount  the  promised  big 
offense 

Hj  *  enemy  Is  just  feeling  us  out 
Hq  *  enemy  wants  to  negotiate 

llr  *  none  of  the  above  situations  hold 
Table  5.  Typical  Set  of  Values  for  domfH). 


Thus,dom(H)  could  serve  as  a  leglmate  sample 
space,  If  conditional  probability  p(H|0,S)  could  be 
obtained  for  all  possible  values  of  H  In  dom(H).  I.e. 
(H)0,S)  could  be  Interpreted  as  a  random  variable 
over  dom(H),  In  this  case,  suppose  also  that  Z  Is  an 
auxiliary  variable  representing  any  of  a  likewise  col¬ 
lection  of  disjoint  exhaustive  situations  locally  go¬ 
ing  on  at  the  bunker.  Here,let  dom(Z)  be  given  as  In 
Table  6  below: 


Zj  *  nothing  happening 

Z2  *  accidental  explosion  In  compartment  fl 

Z3  •  accidental  explosion  In  compartment  IZ 

Z.  *  enemy  shot  missile  at  us  and  It  either 
hit  us  or  Just  missed 

Zg  *  none  of  the  above  situations  hold 
Table  6.  Typical  Set  of  Values  for  dom(Z). 


Thus,  again  by  disjointness  and  exhaustion.  It 
Is  reasonable  to  conclude  that  dom(Z)  could  serve  as 
a  legitimate  sample  space  and  Z  can  be  Interpreted  as 
a  random  variable.  AH  of  this  leads  to  the  evaluation 
of  the  conditional  probabilities  p(Z|D,S),  which  to¬ 
gether  with  the  values  for  P (H | D.S )  can  be  used  to 
obtain  the  standard  "integrated-out"  form  for  the  post¬ 
erior  distribution  of  H  as  given  below', 

5 

p(h*h,|das)*  l  p(H,iz, |das) 

i  i*i  J  ' 

s 

■  l  p(Z.|DAS)-p(H,|Z.mS)  ,  (4.2) 

fwl  1  J 

using  the  standard  chaining  property  of  conditional 
probabilities  and  replacing  the  antecedent  comma  no¬ 
tation  by  conjunctions.  One  could  reasonably  Interpret 
the  evaluation  In  (4.2)  as  the  probability  value  for 
the  expression 

"If  D  and  S.then  Hj"  (4.3) 

through  the  probability  values  for  the  expressions 


P(FU)  -  p(HjO.S)  ,  (4.1) 

where  for  reasons  of  convenience  from  now  on  we  sup¬ 
press  the  danotlonal- time  Indices,  unless  necessary. 

As  stated  before,  p  need  not  necessarily  refer  to  ord¬ 
inary  probability  evaluation,  but  nay  represent  other 
evaluations  such  as  possibilities  for  Zadeh's  Fuzzy 
Logic  or  for  more  general  multivalued  truth  systems. 

In  determining  the  above  evaluation,  another  var- 


"If  0  and  S,  then  Z("  and  "If  Z^  and  0  and  S,  then  Hj 

(4.4) 

Of  course,  one  need  not  use  the  above  evaluation  ex¬ 
actly  to  obtain  useful  equivalent  values.  As  It  standv 
P(Z(|DIS)  can  be  Interpreted  as  an  error  or  variability 
probability  for  attribute  Z,  while  p(H,|Z,kDlS)  can  be 
understood  to  mean  tha  inference  rule  probability  com- 
nectlng  7  and  0  and  S  with  H.  On  the  other  hand,  often 
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the  conditional  data  or  regression  probability 
p(S|Z(lHj)  and  the  joint  prior  probability  pCZ^tllj) 

are  available,  assuaing  here  0*1,  which  by  use  of 
Bayes'  theorea  also  yields  p(H*Hj|0tS).  One  standard 

result  is  to  assuae  the  above  probabilities  are 
gausslan,  which  In  the  discrete  problea  here,  aust 
serve  as  very  rough  approximations-  In  addition,  the 
sets  doa(H)  and  dom(Z)  are  not  easily  ordered  com¬ 
patible  with  a  real  doaain  for  gausslan  random  var¬ 
iables  .  Then,  if  the  aean  of  the  conditional  data 
distribution  Is  linear  In  the  data  S,  p(H,SZ,|S) 
takes  on  a  generalized  weighted  least  squared  fora. 
(See,  e.g.  [18].)  The  final  result.  p(H*Hj|l),  as  In 

(  4.2),  Is  then  a  mixture  of  the  probabilities  of 
such  least  squares  estimators. 


S.  STRUCTURE  FOR  DATA  FUSION:  THE  CLASSICAL 
PROBABILITY  CASE  MODIFIED 

Retaining  the  sane  terminology  as  before,  sup¬ 
pose  now  that  H.Z.S  are  variables  such  that  any  of 
the  corresponding  "sample  spaces*  do  not  truly  con¬ 
tain  disjoint  exhaustive  events;  In  particular,  the 
dlsjointness  condition  may  be  violated  more  often 
than  exhaustiveness-  which  we  will  assuae  here  Is 
always  satisfied.  Then  It  follows  that  simple  cor¬ 
responding  probability  measures  as  In  Section  4  can¬ 
not  be  Immediately  assigned.  Nor  should  "brute- 
force*  normalization  procedures  be  employed,  unless 
absolutely  necessary.  For  example,  consider  H.  Sup¬ 
pose  In  the  above  example  In  Saxtlon  4  (Table  S),  the 
enemy  could  simultaneously  mount  the  promised  offense 
(H-),  yet  also  be  feeling  us  out  for  peace  (H-),  or. 
evin  additionally, wanting  to  negotiate  (H.).  Thus,  In 
that  case,  dom(H)-(H. ,. as  It  stands.  Is  not  a 
suitable  sample  space  of  disjoint  elementary  events. 
Indeed,  the  elementary  events  H,  are  not  so  element¬ 
ary,  many  of  them,  due  to  complex  causes,  being  over¬ 
lapping:  Equivalently,  H  In  Its  current  form  may  not 
be  a  legitimate  random  variable.  What  to  do? 

Note  first  that  It  Is  reasonable  to  assume  that 
the  simple  labels  H.  really  represent  complex  phenom¬ 
ena  and  may  b«  better  described  through  factors  con¬ 
tributing  to  them.  For  example,  same  factors  for  H 
In  Table  5  are: 


•l 


importance  of  node, 
a2  "  relative  strengths  of  us  and  them, 
a}  ■  past  and  present  Incoming  salvo  rate, 
a4  •  duration  of  war  to  this  point, 

Oj  *  what  the  enemy  knows  about  us:  location, 
ag  •  present  weather  conditions, 

a-  •  safety  level-coordination  level  to 
prevent  accidents; 
a  i  a1*  -*a7. 

Then  Ideally,  In  turn,  given  enough  of  these 
factors,  define  rigorously  the  H.'s  In  terms  of  com¬ 
binations  of  values  of  the  a.'s.  One  simple  approach 
Is  to  determine  the  natural  Bomalns  of  values  for  the 
ak's  .  dom(a),  k*l,..,7,  letting 


and 


V  4  dom(a1 )*• -»dom(a7) 


"J  "J.l 


°J,7 


S  V 


(5.1) 

(5.2) 


where  b,  .  e  a. 

the  overlapping 


Is  determined  by  H.,  J-1,..,S.  Thus, 
of  the  H4's  In  general  will  not  dis- 


wil  uvwi  i  ny  wi  me  n  .  a  in  <gciici  «i  n  i  i  i  nut  wij- 

appear,  but  rather  will  be  clarified,  l.e..  In  general. 


"J 


«H,  M 
J? 


(5.3) 


Clearly,  In  this  case,  tf  all  statistical  relations 
between  the  aevlv-lnfroduced  factor  variables  at  's 
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and  the  variables  S  and  Z  are  known,  then  the 
p(Hj|ZjkC£S)  can  be  computed  In  (4.2).  For  example, 

if  the  at  given  the  Z.&D&S  are  all  mutually  statis¬ 
tically  Independent,  then 
7 

(5.4) 


p(HJ|Z1B0*S)  *^p(ak  c  b;J  k|Z1ADAS) 

el 

5 

T  p(h.  | z.to&s)  >  i  . 

j*i  i  1 


and  in  general 
5 


(5.5) 


and  the  coaiputatlon  In  (4.2)  Involving  sumolng  over 
the  domain  of  Z  Is  no  longer  valid  If  Z  also  repre¬ 
sents,  as  H,  possibly  complex  overlapping  events. 

One  approach  to  redefining  the  problea  here  Is 
to  replace  the.  In  genera),overlapp1ng  H.'s  and  over¬ 
lapping  Z.'s  by  suitable  partitioning  ofJtheir  domain 
spaces  ani  then  recompute  the  corresponding  condition¬ 
al  probabilities  In  (4.2)  Involvlna  the  partitioning 
variables.  For  example,  for  convenience, denoting 


I 


0....5)  . 

for  any  subset  ICsI,  or  equivalently,  KcP(I)  (power 
class  of  I,  the  class  of  all  subsets  of  I),  define 


(5.6) 


Hm  4  "  Hi  -  u  Hi 

JcIC  1  JcNIC  J 

£  V  . 

(5.7) 

M(k,  (Hj  |  JcIC)  t  P(dom(H) ) 

(5.8) 

Thus  for  K-e, 

H[»]  *  H(.)  ’  *  ‘ 

(5.9) 

for  K-(j>,  Jxl, 

H«J»  -<Hi>  * 

(5.10) 

and  for  IC*I, 

Hjjj  *  dom(H)  ;  Hjjj  *  n^ 

HJ  1 

(5.11) 

and  for  example,  for  K*{l,2,4}p 

H[IC]  1  H]  "  (H3  u 

V  • 

(5.12) 

Clearly, 

H  i  (H[k]1*  6  I,  H[|(]  t  a) 

(5.13) 

is  a  disjoint  exhaustive  partitioning  of  V.  In  a  sense, 
H  Is  the  tightest  disjoint  exhaustive  partitioning  of 
V  which  generates  back  all  M/s  through  disjoint 
unions.  Thus.W  can  serve  as  Ja  sample  space  in  place 
of  Initial  dom(H);  the  H  's  are  in  general  overlapping 
coaqwund  events  of  H.  similar  comments  hold  for  Z. 

Note  that  the  mappings  Hj  j : P( I )  -  P(dom(H)) 
and  Hj  j:  P(I)  *  P(P)  are  Injective  (1-to-l  Into), 

for  all  K, !  such  that  t  •.  Hence  we  have  the 
bljectlve  relation  for  all  1C  suen  f  t 


1C  —  Hi 


[K] 


—  H, 


(1C) 


(5.14) 


For  any  Jcl,  define  the  filter  class  of  H,  ,  or 
one  point  coverage  class  of  Hj,  as 


G(Hj)  4  (h(k)I^Kc-u 

2  F(Hj)  4  ^  1 

(5.15) 

define  similarly. 

F[Hj]  4  {H[k]lJtK4l*H[K]  *  *K 

(5.16) 
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Note  also  that  the  napping;  Fj  j  :dom(H)*PP(dom(H) 
and  Fj-  j:dom(H)  ■»  PP(P)  art  Injective.  Note,  further, 
for  any  jcl,  the  bljectlve  relation; 


HJ  *  0 


iF[Hj]  ~  FCHj] 


F(Hj).  (5.W) 


{jCljeKcD 

No«  let  (o,S, p)  be  a  probability  ;pace  and 
U:0  »  V  be  a  randoai  variable  corresponding  to 
(||Z.iOtS).  In  turn,  define  randoai  ;ub;et  sy>  of 

dom(H),  sl^:a  -»  P(doai(H)),  where  for  any  u  c  n. 


4"  d  (Hj  | Jcl  ,W((u)  e  Hj)  . 


(5.18) 


Then  it  follow;  that 


complex  and  possible  overlapping  nature;  of  the 
event;  In  dom(H),  then  by  letting  U  be  any  uniformly 
distributed  random  variable  over  [0,1]  and  defining 
the  nested  random  subset  S^2'  of  dom(H)  by 

S*2)  S  poss^([U,l]) 

-  {Hj j jcl ,  possH(Hj)  i  U).  (5.22) 

It  follows  that  for  all  jcl, 

Hj  c  iff  possH(Hj)  a  U  ,  (5.23) 

whence  there  exists  a  legitimate  probability  masure 
p:PP(dom(H))  —  [0,1]  such  that 


ItH.  Iff  or 

J  Ot|jclCsI.HwP*} 

Iff  or 

{K|jcKsI,Hwf*) 

lff41)*F(Hj) 

Iff  Hj  esjj1*. 


(H  c  H[l(]) 
«SH1}  *  HdO> 


Hence 

Theorem  2.  (See:[l9];  [17] jp. 379-381 .) 
For  all  Jcl, 

poss(Hj)  *  p(U  e  Hj)  •  p(Hj  c  S*1’) 
-  p(Hj | ZjlDiS) . 


(5.19) 


(5.20) 


The  significance  of  this  theorem  will  be  more 
apparent  below.  Note  also  that  unless  dom(H)  Is  a 
disjoint  partitioning  itself  of  t>.  (5.5)  holds;  but 
it  always  follows  that 

l  P(WcH[k])  •  1  (5.21) 

Ksl 

Again,  similar  results  hold  for  dom(Z)  replaced  by 
a  suitable  space  resulting  from  appropriately  chosen 
factors . 


possH(Hj)  -  P (H j  c  s'2))  -  p(s'2)  c  G(Hj)) 

■si,  ■  W-  «•«» 


Remarks, 

Note  first  that  the  two  definitions  for  SH  will 
differ  In  general  in  structure,  but  are  both  "(among 
many  other  possible  definitions  for  such  random  sets* 
[17],  Chapter  5)  one  point  coverage  equivalent  to  the 
given  arbitrary  possibility  function  over  dom(H).  (For 
comparisons  of  choices  among  such  candidate  random 
sets,  see  [20],  where  entropy  Is  used  as  one  criterion) 
Each  domain  value  H,  is  naturally  identifiable  with  the 
filter  class  G,H  ,  containing  all  possible  sets  of  H, ‘s 
having  also  Hj'*V  In  them,  l.e.,  all  possible  sets  of 

interactions  H,-.  ,  J  in  It.  Thus  it  is  not  unreasonable 
that  the  glven'posslbll ity  value  assigned  to  H,  can 
also  be  expressed  rigorously  as  a  probability  Jinvolv- 
the  next  higher  order  Interaction  domain  P(dom(H)) 
above  dom(H).  Again,  as  before,  all  results  hold  for  Z. 

In  a  word,  the  posslbil fstlc  or  general  fuzzy  set 
approach  Is  seen  to  be  essentially  a  weakened  form  of 
the  full  random  set  approach,  where  any  one  of  the  one 
point  coverage  equivalent  random  sets  S  Is  fixed  for 
the  modeling  over  P(dom(H)),  replacing  dom(H).  This 
can  be  thought  of  as  being  somewhat  analogous  to  the 
situation  where  a  probability  distribution  describing 
a' problem  Is  only  partially  specified,  such  as  up  to 
the  mean  and  variance. 


On  the  other  hand,  often  we  do  not  know  all  the 
relevant  factors  or  subvariables  contributing  to 
given  compound  events  and  even  If  these  variables  can 
be  pinpointed,  often  we  do  not  know  their  natural  do¬ 
mains  or  perhaps  do  not  know  the  distributional  re¬ 
lationships  Involved,  etc.  Thus  the  technique  of  con¬ 
structing  directly  a  product  space  ,  such  as  V  for  H, 
as  above,  may  not  be  appropriate. 

However,  we  can  still  make  the  basic  Identifica¬ 
tions  In  (5.14)  and  (5.17).  where  we  omit  all  the 
square  bracket  expressions.  Suppose  now  that  prob¬ 
abilistic  evaluations  are  available  such  as 
p(Hj|Z.A0AS)  and  p(Z. |DAS)  for  all  1  and  J  ,  but  that 
the'lpois1b1e  overlapping  nature  of  the  compound  events 
Is  taken  Into  account.  For  example,  these  calcula¬ 
tions  could  be  obtained  from  experts  by  soliciting 
the  Individual/marginal  possibilities  occurring  with¬ 
out  regard  to  the  Joint  or  overall  occurrences  of  the 
remaining  events. 

Can  these  individual  probabilities  or  possibili¬ 
ties  be  made  compatible  In  a  rigorous  manner  with  the 
previous  random  set  construction?  The  answer  is  Yes. 


Finally,  homomorphic-like  relations  (involving  the 
one  point  coverage  relations)  can  be  established  be¬ 
tween  a  number  of  operations  established  among  possi¬ 
bility  functions, or  fuzzy  sets,  representing  general¬ 
ized  unions.  Intersections,  and  other  set-like  opera¬ 
tions,  and  corresponding  ordinary  set  counterparts 
applied  to  the  one  point  coverage  equivalent  random 
sets.  (See,  e.g.  [17],  Chapter  6.)  Some  of  these  re¬ 
lations  will  be  used  in  Section  6  for  representing 
data  fusion  In  terms  of  the  general  combination  of 
evidence  problem.  (In  a  related  vein,  see  [21]  *or 
some  recent  work  using  random  sets  In  modeling  prob¬ 
lems.) 


6.  STRUCTURE  FOR  DATA  FUSION: THE  GENERAL  FIXED 
ANTECEDENT  CASE 

The  results  of  the  previous  section  point  up 
somm  of  the  difficulties  Involved  in  evaluating  prob¬ 
abilities  for  apparently'disjolnt  elementary"  events 
which  are  in  reality  compound  overlapping  and  diffi¬ 
cult  to  define  precisely. 


Theorem  3. ([17],  Chapter  5) 

If  possH:dom(H)  •»  [0,1]  Is  any  function,  perhaps 
represent1ngnthe  expert  opinions  of  a  panel,  as  human 
Integrators  of  Information,  taking  Into  account  the 


Following  the  philosophy  of  approach  outlined  In 
Figure  4,  we  will  establish  a  general  procedure  for 
treating  the  combination  of  evidence  problem,  which 
reduces  to  the  probability  or  possibility  cases  when 
appropriate.  Ideally,  this  procedure  should  reflect 
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cognition  (box  l  in  Figure  4),  the  first  stage  follow¬ 
ing  Initial  "signal*  detection,  but  for  purposes  of 
simplicity  this  will  be  omitted  in  the  present  paper. 

In  particular,  consider  the  crucial  expression 
£  for  data  fusion  appearing  as  prinftive  intranodal 
relation  (1)  in  Table  1,  sans  the  probability  evalua- 
t Ion, and  in  natural  language  form: 

£  &  "If  D  I  S,  then  H“.  (6.1) 

In  symbolic  form,  where  *  represents  1,  v  repre¬ 
sents  "or",  (  )*  represents  "not",-*  represents  impli¬ 
cation, 

J*(0d  IH).  (6.2) 

Suppose  next,  the  following  two  basic  properties 
told  for  the  natural  language  used: 

(a)  letting  T  represent  absolute  truth,  for  any  pro¬ 
position  a  , 


i.e.,  T  plays  the  role  of  a  multiplicative  unity  w.r. 
t.  "and8,  and  can  be  denoted  w.l.o.g.  as  1.  Dually, 
we  can  assume  the  existence  of  an  absolute  falsehood 
F  and  let  it  play  the  role  of  an  additive  zero  w.r.t. 
"8r". 

(b)  "l"  and  "or"  are  coaautatlve  and  associative 

with  "l"  being  distributive  over  "or". 

These  properties  are  quite  mild  and  will  serve 
in  no  way  helre  to  restrict  our  choice  of  AIDP  (alge¬ 
braic  logic  description  pair).  The  four  examples  in 
Figure  4  all  satisfy  these  conditions. 

(I)  Suppose  also  that  auxiliary  attribute  variable  Z, 
used  to  connect  D  and  S  with  H,  is  such  that 

or  (Z.)  *  T  .  (6.4) 

Z,  c  doe(Z)  1  0 

Equivalently,  this  means  that  the  possible  "values"  of 
Z  are  exhaustive,  even  If  they  overlap.  Symbolically, 

v  (Z.)  •  1  .  (6.5) 

Z(  c  dom(Z)  1 

(II)  Suppose,  further,  that  Z  relative  to  0,S,and  H, 
is  such  that 

£  •  "If  D  i  S.  then  H  or  *"  ,  (6.6) 

where  , 

t  ■  or  (Z.|  t  not  Zj).  (6.7) 

Z(  c  dom(Z) 

In  many  formal  languages,  the  law  of  Excluded 
Middle  holds  so  that  for  all  propositions  a, 

a  4  not(o)  *  F  .  (6.8) 

0 

But  in  many  multiple-valued  logics,  such  as  Zadeh's 
Fuzzy  Sets.  (6.8)  does  not  told,  and  an  alternate 
condition  must  be  sought  to  obtain  the  desired  re¬ 
sults  we  seek.  (See  also  Example  2,  Section  7.) 
Symbolically, 

£  •  (D-S  4  |H  v  *))  ,  (6.9) 


♦  •  v  (2]  U  ').  (6.10) 

Z,  c  dom(Z)  1 

Then  If  we  apply  (a),(b),(1),(11)  to  (6.1),  we 
obtain  In  symbolic  form 

£  •  (0-S  d  v  (  H-Z,  v  Z.-Z  •  )  ).  (6.11) 
Z,  t  dom(Z)'  1  1 


Next,  two  more  restrictive  assumptions  are  made: 

(c)  The  antecedent  of  Implication  is  distributive 
over  "or";  equivalently,  a  homomorphism  exists  rela¬ 
tive  to  "or"  for  a  fixed  Implication  antecedent.  Thus 
for  any  propositions  o, a_  ,  8  , 

I  IH 


(8  d  (v  a,))*  V  (8  da,). 
1-1  1  1-1  1 


(d)  Implication  chains  relative  to  Thus  for  any 
propositions  o,b,y. 

(y  d  (a*B  v  8*6'))  "(yd  bMy'B  d  a).  (6.13) 

Again,  It  can  be  shown  quite  readily  the  first  3 
ALDP  examples  in  Figure  4  are  such  that  their  Tormal 
language  components  satisfy  as  well  (c)  and  (d),  when 
implication  Is  interpreted  as 


where  for  all  a, 8 

(8  a)  *(6'  V  a) .  (6.15) 

(See  Examples  1-3,  Section  7,  where  AIDP  1-3  are  pre¬ 
sented  in  some  detail.  For  AIDP  4,  see  Section  8.) 

Theorem  4. 

Suppose  a  formal  language  of  propositions  satis¬ 
fies  constraints  (a)  ,(b)  ,(c) ,(d) .  Suppose  also  that 
variables  D,S,H,Z  are  to  be  Interpreted  as  before  In 
the  general  sense  and  are  such  that  (i)  and  (11)  are 
satisfied,  then 


£  *  v  <( Z. ;D,S ;H) ,  (6.16) 

Z,  c  dom(Z)  1 

where  for  all  Z1  In  dom(Z), 

£(Z, ;D,S;H)  S  (D-S  S  Z,-H) 

-  g(Z1;0,S).h(H;Z1;0.S),  (6.17) 

where 

g(Zj',0,S)  ■  (D-S  d  Z,)  (6.18) 

can  be  Interpreted  as  an  attribute  variability  or 
error  form  and 


h(H;Zt;D,S)  -  (Z, -D-S  d  H) 


can  be  Interpreted  as  an  Inference  rule  connecting  Z, 
end  N. 


Thus. from  the  remarks  preceedlng  Theorem  4,  the 
formal  language  for  Classical  logic  and  Probability 
Logic,  boolean  algebra,  with  implication  given  In 
(6. 14), (6. 15), satisfies  (6.16)-(6.19).  Similarly,  the 
modified  boolean  algebra  representing  the  formal 
language  of  Zadeh's  Fuzzy  logic  (mln-max  type)  also 
satisfies  the  above  formal  relations  for  the  decompo¬ 
sition  of  the  key  expression  for  data  fusion  £. 

In  turn,  we  seek  the  full  semantic  evaluation  of 
the  data  fusion  expression  through  probability  or 
possibility  or  other  means,  compatible  with  the  re¬ 
sults  of  Theorem  4. 

In  order  to  accomplish  the  above  goal,  we  first 
review  some  concepts  which  may  not  be  too  familiar  to 
many.  Define  a  copula  a4  as  a  mapping  ♦jrfO.l  ]n-[0,l] 

which  is  the  same  as  a  cumulative  probability  distri¬ 
bution  function  over  (0,1  ]*>  such  that  each  marginal 
distribution,  of  one  dimension  corresponds  to  a 
random  variable  U,  uniformly  distributed  over  [0,1], 
1-1,.., n.  (Copulas  can  be  used  to  solve  elegantly  the 
important  problem  of  determining  all  possible  joint 
distributions  given  specified  marginals.  See  [22].) 
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for  purpose  of  simplicity  here,  define  a  co-copula 
*or  as  a  napping  *or.:[0,1]n-«-[0,l]  which  coincides 

with  the  disjunction  probabilities  corresponding  to 
the  conjunction  ones  for  some  given  copula.  Thus  if 
U<  is  any  r.v.  uniformly  distributed  over  [0,1],  for 

t-l,..,n  ,  and  (U. ...,U  )  has  some  legitimate  joint 
distribution,  then  *.  defined  as  follows  will  be  a 
copula  and  a  defined  below  will  be  the  co-copula 
corresponding" to  *&: 

For  any  c^  c  [0,1],  i  c  Ifl  ^  (1,..,n), 
♦&(el“.,cn}  “  P<(S/U1  S  cin'  (6.20) 

♦or(el  —  * enl  ‘  p(151(Ui  '  'i11 

-  X(-l)c*rdtK)+1-a .(e .  [6. 21) 

•l*K4l0  *  1  ' 

where  analogous  to  previous  notation 


with  h(l)  *  0  and  R  denoting  the  extended  real  line 
Including  +-,  such  that,  assuming  the  above  pair  is 
also  demorgan, 


♦i(xl 


,xn* 


.-1 


(min(h(o),  Jh(x.))) 
1*1  1 


(6.28) 


conversely,  any  such  h  as  above  generates  a  legitimate 
archimedean  pair,  where  the  t-norm  part  Is  given  in 
(6.28). 


Next,  for  convenience  define  for  all  i,j 

a  -  (D-S  3  Z)  ;  a,  i  <D-S  3  Z,)  ;  (6.29) 

t  ^ ( 2- D- S  3  H)  5  8ij  (Z^O'S  S  Hj).  (6.30) 

Then  make  the  following  semantic  evaluation  of  2 
preserving  the  formal  structure  Tn  Theorem  <: 

P0SS(2  ■  5j)  *  poss(0  -  (D*S  =9  ti j ) ) 


C(K)  i  <eil,tK}*  (6.2?) 

by  use  of  the  modularity  or  PoincarS  expansion  proper¬ 
ty  of  probabilities,  (for  further  properties  of  copu¬ 
las  and  related  functions,  see  e.g.  [17],  Section 
2.3.6.)  Consider  also  the  followino  related  concepts: 


*  ♦orU4(possa(»1).poss|(6(J})). 

1t!  (6.31) 

In  particular,  the  evaluation  of  £  using  Zadeh's 
original  fusty  set  theory  or  Futty  Logic  is  easily 
seen  to  be  a  special  case  of  (6.31),  when 


Define  a  t-norm  -  also  denoted  as  a.  -  as  a  map- 

aw  ® 

ping  *,.[0,1]  ■»  [0,1]  which  is  associative,  commuta¬ 
tive,  lion-decreasing,  continuous,  and  possessing  bound¬ 
ary  conditions 

♦jO.x)  •  x  ;  ♦1(0,x)  •  0  .  (6.23) 

for  all  Osxsl ,  and  such  that 

*j  i  min.  (6.24) 

Similarly,  define  a  t -conorm  as  the  demorgan  transform 
of  some  t-norm 

♦or(V*V  "  ’■  (6.25) 

for  all  x^,..,xn  c  [0,1],  .Also,  define  an  archimedean 
t-norm  as  a  t-norm  where  for  all  0*x<l , 

♦t(x,x)  <  x  ;  (6.26) 

dually,  define  a  t-conorm  to  be  archimedean  iff 


*  min  ,  *or  ■  max.  (6.32) 

More  generally,  the  PACT  algorithm  [12],  briefly 
mentioned  previously,  can  also  be  shown  to  be  essent¬ 
ially  a  special  case  of  the  data  fusion  evaluation 
given  in  (6.31),  where  now  and  *Qr  are  in  certain 

paramterited  families  of  conjunction  and  disjunction 
functions.  In  the  PACT  algorithm,  data  association  or 
•correlation"  is  to  be  determined  to  hold  or  not  for 
a  feasible  pair  of  developing  track  histories,  where 
in  addition  to  geolocation  information, present  may  be 
other  attribute  forms.  A  typical  example  is  where 
Z  represents  the  following  potential  matching  attri¬ 
butes  for  the  two  tracksill  and  12): 

geolocation  parameters  for  fl ,  for  12 
sensor  system  parameters  for  t\f or  12 
7  .  hull  lengths  for  #1,  for  12  ,,  ... 

classifications  for  #1,  for  #2  Ao.si) 

flag  colors  for  fl ,  for  #2 


♦0(.(*.*)  >  *  •  (6.27) 

for  all  0<x<1  . 

Consider  some  examples  of  conjunction  and  disjunc¬ 
tion  function  pairs  being  copulas  or  t-norms  with  co¬ 
copulas  or  t-conorms. 

First,  it  should  be  noted  that  (min, max)  and 
(prod.probsum)  are  the  only  such  functions  which  are 
both(copul*,co-copula)and(t-norm,t-conorm)pa1rs  simul - 
taneously;  further,  the  latter  pair  is  also  archimedea^ 
where’prod*denotes  ordinary  arithmetic  product,  while 
'probsuaf denotes  formal  probability  "sum"  (displaying 
modularity  of  probability)  as  the  demorgan  transform 
of  prod.  (See  [23],  Section  4.) 

(prod, sum)  is  a  ncn-denorgan  archimedean  pair, 
where  sum  Is  to  be  interpreted  as  ordinary  arithmetic 
sum  ,  but  bounded  by  unity;  tha  latter  is  a  t-conorm 
but  not  a  co-copula. 

Finally,  to  complete  this  brief  preliminary  dis¬ 
cussion,  the  important  canonical  representation  theorem 
for  archimedean  pairs  of  t-norms , t-conorms,  states  that 
for  any  such  pair  (*j,*  ),  there  always  exists  a  cor-  + 
responding  continuous  non- increasing  function  h:[0,1]-»ft, 


Also,  for  this  example,  H  (denoted  in  [12]  by  6)  rep¬ 
resents  correlation  level  between  11  and  12  (between 
0  end  1  when  evaluated),  while  0*1  is  assumed  and  S 
represents  observed  (in  error)  counterpart  of  Z.  Then 
the  inference  rules  possg(8  .)  correspond  to  some  ex¬ 
pert-derived  (or  der1vedcby1J  analytic  or  physical 
considerations)  relation  between  some  combination  of 
degrees  of  matching  attributes  in  general  with  poss¬ 
ible  correlation  levels  H  ;  the  terms  poss  (a, )  rep¬ 
resent  error  distributions  between  true  ana  observed 
auxiliary  attributes  Z.  PACT  can  operate  upon  a  mix 
of  probabilistic  information  and  attributes  and  lin¬ 
guistic-based  information  and  attributes,  as  shown 
in  (6.33),  where  typically  the  first,  second,  and 
possibly  the  third  entries  are  in  stochastic  form, 
while  the  remaining  entries  are  narrative-based  and 
given  in  natural  language.  The  basic  PACT  output, 
before  further  integration  into  an  overall  tracking- 
correlator  design,  is  the  posterior  description  of 
correlation  based  upon  observed  or  reported  data  in¬ 
volving  the  track  history  pair  in  question,  as  is 
represented  in  (6.31)  by  poss(Q*Qj). 

On  the  other  hand,  if  we  choose 

*J  *  prod  ,  *or  ■  sum  ,  (6.34) 
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g.*  v,n  ur^n^v,1  v*j  \pjv»m^«mi,v.w. 

.  i , 

UNCLASSIFIED 


then  (6.31)  reduces  to  the  classical  probabilistic 
data  fusion  evaluation  given  In  (4.2). 


Next,  consider  the  evaluation  of  data  fusion  as 
given  In  (6.31)  when  f&  Is  any  copula  and  ♦  Is  the 

co-copula  determined  by  d&  as  in  (6.21),  compatible 

with  the  data  fusion  problem  as  modeled  here.  Thus, 
similar  to  the  specific  example  given  In  Section  5, 
but  with  generality  In  mind, using  (6.29) ,(6.30) ,  let 
(fixing  0  and  S) 

dom(a)  *  (e^ltl)  dom(Z)  -  {Z  |1d},  (6.35) 
dom(B)  -  (B^llcI.JeJ)  •••  dom(Z)*dom(H) 

•  ( ( Z| ,Hj) 1 1  cl  ,JcJ),  (6.36) 

where  I  and  J  are  suitably  chosen  index  sets. 

Let  H 

n*<Wict. 

uj 


be  any  stochastic  process  where  each  marginal  Uj 
and  Uf j  is  some  random  variable  uniformly  distributed 


over  [0,1],  Then  define  random  subsets  S 
and  of  dom(s)  by  .  for  all  IcI, JcJ,  a 

of  dom(a) 

°1  1  So 

*1  *S« 
and 

Iff  Uj  t  possa(a1) 

Iff  U|  >  POSSb(«,) 

(6.38) 

•u  C  SB 

Iff  UyS  post  (8^) 

(6.39) 

8U  8  5» 

Iff  UyW  posse(8(J) 

• 

Note  that  If  the 
the 


t  If  the  U,  are  all  Identical  and  .separately, 
U(j  are  all  Identical,  then 


c(2) 


c<2) 


(6.39) 


as  given  in  Theorem  3.  Determine  ♦i,eo(.  through  U_, 


Then  It  follows  ths’  the  evaluation  of  data 
fusion  In  (6.31)  becomes.  using  (6.21 ) ,(6.35)-(6.39) , 

posstQ-dj)  •  y-l)C,rd(lC>^*  Huj  (6.40) 

where  for  all  subsets  K 


(6.31)  and  assuming  the  constructions  In  (6.35)-(6.39) , 
It  follows  that  for  all  JcJ, 

poss(C>*CLj)  *  poss(  Aj  n(Sa  <S^  l) 

*  P(  Aj  n(SB  »  Sg)  f  •  ) 

■  pious,  K  -  (A.)  ,  (6.44) 

a  8  J 

where  plaus^  x  s  denotes  the  plausibility  or  upper 
a  0 

probability  measure  with  respect  to  random  subset 
S  *  S.  of  dom(a)*don(8). 

a  p 

■ 


Remarks. 

For  related  results  and  general  background,  see 
[17],  Chapters  3  and  4.  Shafer  [24]  Independently  has 
developed  use  nf  plausibility  measures  and  other  bl- 
Jecttvely  related  functions,  such  as  ’belief*  and 
’doubt*  measures  in  modeling  combination  of  evidence 
problems.  However,  Nguyen  [25]  has  emphasized,  via 
Choquet's  Capacity  Theorem,whtch  characterizes  such 
functions  in  terms  of  both'thelr  random  set  connect¬ 
ions  and  their  generalized  Poincart  expansion  forms, 
that  such  ’measures*  require  full  rrecl flcatlon  of 
the  associated  random  (sub isets .Contrast  such  modeling 
with  that  employing  possibility  functions  In  a  general 
multiple  logic  context,  as  given  above,  using  some  pair 
of  conjunction  and  disjunction  functions.  As  shown  In 
the  previous  section  and  here,  the  latter  approach  only 
In  effect  requires  knowledge  of  the  one  point  coverage 
functions  of  the  relevant  random  sets  involved.  Even 
In  Theorem  5,  where  an  equivalent  plausibility  desertyt 
Ion  Is  given.  It  Is  only  specified  over  the  A.’s.  In 
short,  any  plausibility  measure  Is  determlned'>by  the 
Incidence  function  of  some  appropriate  random  set  with 
all  ordinary  subsets  of  the  space;  any  belief  measure 
Is  determined  by  the  superset  coverages  of  a  random 
set;  any  doubt  measure  Is  determined  by  the  subset  cov¬ 
erge  of  a  random  set. 

In  any  case,  Theorem  5  shows  that  a  homomorphic  re¬ 
lation  exists  between  the  posslbll Istlc  Incidence  form 
of  data  fusion  evaluation  as  g1u»n  originally  In (6. 31 ) 
and  the  corresponding  equivalent  probability  form 
In  (6.44). 


V)1  ♦jUl(p(U1sp0SSa(a1)).p(U1jip0SS8(B1j)))) 
IcK 

•  P(  ♦t(U,*possB(«j),  Ujjiposs^Bjj))) 

IcK 

•  p(  »((«!  e  Sa)  I  (B|j  c  Sf))  ).  (6.41) 


If  In  (6.37),  ^.Instead  of  being  chosen  Identical 
for  all  and  all  l*^  separately.  Is  such  that  all 

are  statistically  Independent  of  each  other  and  of  all 
Ujj  which  are  also  all  Independent,  then  the  resulting 

S„  and  Sg  are  not  only  statistically  Independent,  but 

are  the  maximal  entropy  one  point  equivalent  represent¬ 
atives  for  poss  and  poss.,  respectively.  (See  [20],) 

a  p 


But,  using  the  Polncarl  expansion  of  probabilities, 
(6.40)  and  (6.41)  yield 

PO**(Q*Q.j)  *  p(^or  ((a,  c  SJUBjj  c  S#))  ) 

•  p(  Aj  n(Sa«  Sjf  f).  (6.42) 

where 

A,  *  l(o,  ,8. .)  |1cIW(Z.,Z. ,H.)  |1tl) 

J  1  U  1  1  J  (6.43) 

Noting  that  the  expression  In  the  right  side  of  eq. 
(6.31)  can  bn  written  In  a  natural  way  In  terms  of 
possibilities  analogous  to  that  In  (6.43),  we  obtain 
the  following  result: 

Theorem  S. 

Given  variables  C,S,H  and  auxiliary  variable  Z 
as  before,  then  under  the  assumptions  leading  to  eq. 


In  another  direction,  the  following  Important 
asymptotic  result  holds  for  the  data  fusion  expression 
In  (6.31):  Noting  that  variable  Z  can  represent  a  com¬ 
plex  of  attributes,  some  probabilistic  In  nature, 
others  linguistic-based  in  ntture,  so  that  their  des¬ 
criptions  can  be  possibillstlc  but  not  probabilistic, 
partition  Z  accordingly  Into 

Z-(Z'.Z-).  (6.45) 

where  w.l.o.g.  Z‘  Is  the  vector  of  probabilistic  at¬ 
tributes  and  Z*  Is  the  vector  ef  non-probabll istlc 
ones.  Note  that  by  the  ciDOfiicei  reoresentstton  theor¬ 
em  mentioned  In  Section  6  (see  eq.(6.26),lf  ar  archl- 
nedean  t-norm.  t-conorm  pair  Is  chosen  for  the  evalua¬ 
tion  in  (6.31),  then  poss(Q)  becomes  a  monotone  trans¬ 
form  ,  say,  for  generator  function  h  of  4|,  of  a 

sixa  of  terms  over  Id,  where 

Th(x)  <  1  -  h-,(m1n(h(0).x)).  (6.46) 
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for  all  *  c  R*,  and  tho  11th  tana  ,  isil,,^),  Is 
hO-*4(po**tt,(2^  .S(Z^hj)))).  (6.47) 

■here  a  Is  partitioned  as  Z  Into  (o' .a")  and 

S(Z|  ,H .)  i  ♦orUl(possa.(zy.po.s#(z;.z;.H  ))).(«. 48) 

’  (^  C  do*rr«-Tj  a  1 

Not*  that  dod(Z')  (s  finite, as  well  as  all  other 
doaialns  of  relevant  variables.  In  order  for  finite  ar¬ 
gument  functions  +£  and  eor  to  be  welVdeflned.  In  some 

cases,  these  finite  domains  are  the  result  of  discreti¬ 
zations  and  truncations  of  initial  natural  doaialns 
which  are  infinite  and/or  continuous,  especially  those 
corresponding  to  continuous  probability  density 
functions.  In  this  context,  suppose  all  probabilistic 
attributes,  making  up  Z'  are  such  that  they  correspond 
to  actual  protattltty  density  functions  which  have 
all  been  so  discretized  as  above.  Denote  the  symbol 
11m  (poss(n))  to  mean  that  the  limit  of  poss(<i)  will 

dom(Z'Mr 

be  taken,  if  it  exists,  as  dom(Z')  and  poss  ,  are  re- 

ft 

fined  so  that  all  cell  sizes  approach  point  limits 
and  thus  poss  ,  approaches  a  Joint  p.d.f.  form 
corresponding" to  random  variable  (Z‘|06S).  Then  we 
can  show  the  following: 

Theorem  6.  Asymptotic  limiting  form  for  data  fusion. 
-  (See  [26].) 

Suppose  that  all  of  the  above  assumptions  hold 
together  with  some  mild  analytic  conditions  for  the 
archimedean  t-norm.  t-conorm  pair  ♦-,»  chosen  for 
the  data  fusion  evaluation  (6.41).  *  or 


lim  tpossta-Oj)).  Th(vh-E21(«(6(Z1.MJ)))).  (6.49) 


dom(Z')-*R^ 


v  i(-d  h(x)/dx)  .  .  (6.50) 

and  all  Osxsl.  *  *  ' 

«(x)  i  <J ♦1(x.y)/Jy)y.0  ,  (6.51 ) 

and  where  C.,  denotes  ordinary  statistical  cxpecta- 
tlon  w.r.t.  r.v.  V  ,  conditioned  on  DAS  throughout, 
where  V  corresponds  to  the  limiting  p.d.f.  for 


Thus,  up  to  essentially  monotone  transforms,  the 
limiting  form  of  the  data  fusion  computations  hem 
is  an  averaged  value  of  the  data  fusion  *tth|only)fixed 
domain  attributes  Z*.  Further  simplification  to  the 
classical  integral  (and  continuous)  version  of  (4.2) 
occurs  when  the  fixed  non-probabllisitc  attribute  cosh 
ponents  are  missing.  These  results  can  be  used  for 
data  checks  when  modeling  via  (6.31).  (See.e.g.  [12].) 

For  other  controversies  involving  probability  vs. 
possibility  vs.  Oampster-Shafer  belief .doubt,  etc., 
see  [17], (especially.  Chapter  10), 


7.  STRUCTURE  FOR  DATA  FUSION:  THE  GENERAL 
COniNATIOh  OF  EVIOENCE  CASE 

Let  us  return  to  the  formal  language  aspect  of 
data  fusion  as  given  in  Theorem  4.  In  general  know¬ 
ledge-based  systems  such  as  medical  diagnosis  ones 
consist  of  a  collection  of  inference  rules  corres¬ 
ponding  to  h(H-,Z.;0,S)  linking  either  observed  data, 
such  as  0,S  or  portions  of  intermediate  variable  Z 
with  other  portions  of  Z  or  with  diagnoses  directly, 
played  by  the  role  of  variable  H.  Similar  coaments 
hold  for  the  attribute  variability  term  g(ZjiO,S). 


The  somewhat  similar,  but  mere  general  structure 
for  such  systems  Is  given  In  eq.(7.1). 

.  (7-]) 

5,  8  V  (  •  (A(  Z..H.»n.s)0  fck(z  H  iO.Sj) 

J  Z,  c  dom(Z)  k-1  -  *  ■  1  j _ _  - , 

*4ij  “fekij 

representing  (D-S  9H),  where  for  all  k,  and 

are, possibly  expert-derived,  boolean  functions  ,t.e., 
combinations  of  operations  •  ,  v  ,  (  )‘. 

Next,  to  complete  the  general  data  fusion  theory 
again  referring  to  Figure  4,  we  must  choose  an  ALDP, 
i.e.,  a  pair  consisting  of  a  compatible  choice  of 
formal  language  followed  by  a  semantic  evaluation  or 
logic. 

Consider  then  as  reasonable  candidates  for  the 
evaluation  of  (7.1), AIDE  1,2,3  as  In  Figure  4. 

Example  1 .  ALDP  1 . 

ALDP  1  •  (boolean  algebra  fl  with  (6.14)  valid  for  d  , 
Classical  (two-valued)  Logic  ) 

The  calculus  of  relations  for  Implications  for 
the  formal  language  part  here,  Q  boolean  with  (6.14): 

For  all  a^.Og.^c  Q,1»l,..,m,  m-1,2...., 

v  (8,9  O  *((  •  8,)9  (  v  «.)),  (7.2) 

1-1  11  1-1  1  1-1  1 
m  m  mm 

•  (6,9o.)  *((  v  a,'-B.  v  *B,)9(  •  a,)). (7. 3) 

1-1  11  1-1  1  1  i-r  1-1  1 

Thus,  if  6i*"**b*60*  then  (7.2)  .and  (7.3)  be¬ 
come  homomorphic  relations  for  fixed  antecedents; 

m  m 

V  (B„9  u.)  *(B„9  (  v  a,)),  (7.4) 


v  (*«S  “i)  *(B„9  (  v  a,)). 
i-1  0  ‘  0  1-1  1 

m  m 

•  (6.»a  )  -(6  9  (  •  a.)). 
1-1  0  1  °  1-1  1 


But  negation  Is  In  general  not  a  homomorphic  relation: 

(bo*bo)'  ■  »;-»o  *  (7-6> 

Also,  for  all  a0.B#.Y0  e  B.  (7  7) 

Consider  now  the  semantic  evaluation  part.  De¬ 
noting  the  evaluation  of  any  proposition  variable  a, 
having  domain  of  possible  (or  not)  values  in  B(dom(n) 

6  (l)  as  function  possa:dom(o)  -  [0,1], for  any  a^cdomfad 

poss  (a,)  -0,  I.e.,  at  fa 

or  <7-8) 

poss^fo,)  -  I,  1.#.,  •,  I*. 

and  variable  a  can  be  identified  with  a  subset  of  o: 

a  •  {o^tojc  dom(oj)  f  possa(o1)-l),  (7.9) 

with  poss#  playing  the  role  of  an  ordinary  set  member¬ 
ship  function.  Then, Classical  Logic,  as  a  truth- func¬ 
tional  logic  (see.e.g.  [27]  for  further  elaboration) 
baa  the  following  homomorphic  forms,  for  all  proposi¬ 
tion  variables  (and  similarly  for  all  propositions) 

poss#y|  •  max(possB.possJ).  (7.1cJ 

possB>|  ■  mtn(possB,poss#),  (7.11) 

posSB>  •  1  -  poss^,  (7.12) 
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POSSq  -  0  ,  poss1  •  1  ,  (7.13) 

«nd  hence 

poss8da  -  max(l-poss#  ,  pos$a).  (7.H) 

where  In  *11  of  the  above  equations,  all  functions  art 
understood  to  be  evaluated  at  arbitrary  comnon  domain 
points  component-wise. 

The  usual  presentation  -  which  Is  equivalent  •  Is 
through  truth  tables,  but  the  above  display  allows  for 
natural  generalizations  to  Zadeh’s  (min-max)  Fuzzy 
Logic  In  ALDP  2. 

It  also  follows  that  the  semantic  evaluation  of 
the  data  fusion  form  in  (7.1)  becomes  here: 

possdJ-Cj)  •  POS*D.s  3  h(Hj) 


■  max  (  min  (m*x{1-/ 
Z(c  dom(Z)fk-l,...m) 


klj 


than  for  all  k,1,J 


Skii»  >• 

(7.15) 


j  ^  posiy  (z^HyjD.S)  ,  (7.16) 

^kU  *  PPMfc  (VMj5°'S).  (7.17) 

and  where  the  expressions  in  (7.16)  and  (7.17),  if 
necessary,  can  be  evaluated  further  using  (7.10)-(7.14]L 


But  since  we  have  here  a  simple  two-valued  logic, 
eq.(7.1  )  reduces  to: 


poss(9»dy)  *  1  iff  there  is  some  attribute  value 
Z(  such  that  for  each  k,  k«l,..,m, 
(y'k*  fcfc)  when  evaluated  at  Z^.H^.D, 
S.  is  true.i.e..  Pos^a 

*1  ,  or  equivalently,  Z^.Hj.D.S  all 

fire  Inference  rule  (j.  9  fcj  i  eith¬ 
er  yk  Is  false  at  this  evaluation 

(vacuous  antecedent  being  satisfied) 
or  more  non-trlvlally.  L  is  true 
for  this  evaluation  j  (7.18) 


poss(n-dj) 


0 


Iff  no  such  attribute  value 
above  exists. 


*1  “ 

(7.19) 


Alternatively,  one  can  evaluate  (7.1),  by  first 
directly  applying  the  calculus  of  relations  for  In¬ 
ferences  in  the  formal  language  ((7.2), (7. 3))  and  then 
evaluate  the  result  semantically.  Thus, 


PossjQrSLj )  *  poss(g{Hj  jO.S)*  a(Hy;0,S)) 


m*x(1-poss(g(Hj;D,S)).poss(a(H.;0,S))) 


where 


7.20) 


d  ■  " 

g(N.;0.S)  *  •  (  *  /ki« 

i  Z|C  dom(Z)  k-l^U  k-1  k1J 


) 

(7.21) 


and 


ajH.-.O.S)  i  v  (  •  It,,  ).  (7.22) 

J  Z,e  dom(Z) 


where,  in  turn,(7.10)-(7.14)  could  be  used  to  evaluate 
further  pots(g)  and  poss(a.|,  which  of  course  should 
lead  back  te  (/.IS)  and  tinis  (7. 18), (7. 19),  as  a 
check. 


The  philosophy  of  approach  in  this  ixanple  Is 
that  for  the  eodellng  of  data  fusion, in  the  context 
of  medical  diagnosis,  for  example,  although  truth  can 
only  be  0  or  1 ,  by  Introducing  sufficiently  many  In¬ 


ference  rules  in  the  knowledge-based  system,  multiple- 
valued  truth  logics  can  be  avoided. 

Example  2.  ALDP  2. 

ALDP  2  •  (modified  boolean  algebra  G  with  (6.14)  , 
Zadeh's  (min-max)  Fuzzy  Logic) 

As  mentioned  earlier  (again,  see  Figure  4  and 
associated  remarks  in  Section  2),  ’modified*  boolean 
means  a  pseudo-complemented  (distributive)  lattice, 
or  roughly  a  boolean-like  system  without  the  Law  of 
Excluded  Middle  and  all  Its  consequences  holding. 

(See  [28], pp.  14-16  for  a  related  discussion.  [28]  as 
a  whole  also  serves  as  a  good  Introduction  to  Zadeh's 
Fuzzy  Logic.) 

The  calculus  of  relations  for  implications  for 
the  formal  language  part  here,  0  ,  is  the  same  form¬ 
ally  as  that  for  a  as  in  Example°l ,  except  for  the 
following  slight  modifications: 


(J)  The  middle  equation  in  (7.7)  will  be  valid,  pro¬ 
vided  that  o  s  6„  ,1.e.,  o  •  o  ,  otherwise  In 
0  0  0  0  0 
general  it  Is  not  true. 

(n  )  Adjoin  the  term  v  a  •#'  to  the  consequent  of 
o  o 

a  on  the  left  hand  side  of  the  equality  for  the  far 
right  chaining  aquation  In  (7.7). 


Then  the  semantic  evaluations  precede  In  formally 
the  same  way  as  for  ALDP  1,  but  her*  the  range  of  val¬ 
ues  of  each  possibility  function  is  In  the  unit  Inter¬ 
val  [0,1],  Instead  of  being  restricted  to  the  set 
(0,1),  replacing  (7.81.  Thus  eqs . (7 ,9)-(7.l7)  all  re¬ 
main  valid  here.  Eq . (7 .18)  and  eq.(7 .19)  are  no  longer 
valid  in  the  context  of  ALDP  2.  On  the  other  hand, eqs. 
(7.20)-(7.22)  hold  here,  with  appropriate  modifica¬ 
tions  following  those  in  (I),(n)  above. 


Example  3.  ALDP  3. 

ALDP  3  •  (boolean  algebra  Q  with  (6.14), 

Probability  Logic) 

Since  Q  is  the  same  as  in  Example  1,  all  of  the 
relations  In  eqs.(7.2)-(7.7)  hold  her*  also.  On  the 
other  hand,  the  semantic  evaluation  aspect  -  Probabil¬ 
ity  Logic  -  differs  considerably  from  the  two  previ¬ 
ous  examples.  In  this  non- truth- functional  logic  (see 
again  [27],  especially  Chapter  2,  Sections  26  and  27 
for  background),  we  have  the  usual  basic  (finitely 
additive)  probability  properties,  for  a  given  prob¬ 
ability  measure  p:Q  -  [0,1],  playing  the  role  of  the 
semantic  evaluation  poss  in  the  two  previous  examples. 
(In  order  to  use  the  more  standard  notation,  p  Is  used 
in  place  of  pos^)  Only  for  purposes  of  comparisons  the 
following  well-known  properties  are  given: 

For  all  propositions  oQ,B0  c  Q  , 

p(o„»  ®o>  ’  p<«o>  *  P<V  '  p<V#oJ*  (7'23* 
the  modularity  property,  extending  to  the  Poincare 
expansion,  used  previously  In  this  paper,  where  for 
all  <S|,..,«n  c  n, letting  In*(1,..,n),  n-1,2,..  , 

P(  !  «,)  •  J(-l)c,pd(lt)+1.p(  l.  ),  (7.24) 

1-1  '  *PKSI.  let 

n 

p(.;)  •  1  -  p(a0)  .  (7.2S) 

p(0)  ■  0  ,  P(l)  •  1  .  (7.26) 

resulting  in  the  following  evaluations  for  implication 
(by(6.14),  for  ■*  )  and  some  less-known  inequalities 
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Involving  conditional  probabilities: 

P<»0  *“o}  ‘  p(po  v  V  ‘  1-p{(»ovoo,,)"  1'p(V“o) 

*  p(«0i*0)  ♦  p(«;i»0)  -  p(80*«;) 

*  P(«0I«0>  *  P(°i|eo>  •  P<°ol8o,’p(ao) 

*  p<«0i*0)  ♦  p<-;i»0)-p(«;i 

*  p(«0l80)  (7.2?) 

*  P(«0-80)  .  (7.28) 

where  the  conditional  probability  Is  daflnod  as  usual 

as,  a.g., 

P(«0|80)  i  P(«0-80)/P(60).  (7.29) 

provided  p(0g)  »  0. 

The  above  Inequalities  are  strict, In  general , and 
show  that, basical ly,  we  cannot  Identify  Implication, 
as  defined  in  the  fonaal  language  (a)  via  eq.(6.14), 
with  a  ’conditional  object*  such  as  (a q|b  ),  otherwise 
this  would,  following  evaluations  by  p°ana  Making  the 
natural  Identification 

P((«0|8#))  *  P(«0|80)  .  (7.30) 

contradict  the  inequality  In  (7.27).  Hence  the  behavior 
of  conditional  probabilities,  while  roughly  reseeibllng 
that  of  the  probability  of  leipllcatlons  is  not  the 
saae  -  Indeed,  one  can,  by  choosing  Judiciously  S 
close  to  o  In  soaw  natural  sense,  naka  p(8o£  no)  ° 
approach  unity,  while  for  the  same  choice  of  a-.Bo, 
P(“#l*0)  4PPrMches  Mro-  The  significance  of  these 

results  will  be  explored  further  In  the  next  section, 
where  we  develop  an  ALDP  (1)  where  fonaal  Implications 
a  3  s  can  bm  Identified  with  ’conditional  objects* 

O  0  ■ 

(o0|80).  whose  semantic  evaluations  as  In  (7.30)  are 

conditional  probabilities;  but  In  light  of  the  above 
remarks,  necessarily  these  entities  lie  outside  of  the 
original  space  of  propositions  n. 


p(b0  *ao)  •  p(B;)  ♦  p(ao)  -  p(#;-«0) 

*  P(»;)  ♦  P(«0-80).  (7.35) 

fnr  all  o  ,6-  c  n,  followed  by  use  again  of  the  basic 

O  0 

properties  of  probability  function  p  In  (7 .23)- (7 .26) . 

Obviously,  in  the  above  schemes,  the  number  of 
computations  Involving  probabilities  of  the  conjunct¬ 
ions  of  relevant  events  or  propositions  can  be  quite 
large  and. as  well.it  may  be  difficult  to  evaluate 
each  sih.Ii  conjunction,  unless  some  simplified  depen¬ 
dency  or  other  relations  are  assumed  for  certain  of 
the  events.  As  a  consequence  ,  several  techniques 
have  been  establish’d  for  evaluating  combination  of 
evidence  In  a  knowledge-based  system,  when  marginally 
one  has  available  estimates  of  probabilities,  or  rela¬ 
ted  certainties  or  likelihoods  or  confidences,  etc. 
for  each  of  the  Inference  rule  forms  ( j  9 

Some  of  these  procedures  are  ad  hoc  in  nature,  others 
are  more  analytically  based.  For  a  compendium,  see 
[29]. 


8.  DATA  FUSION  ANO  CONDITIONAL  OBJECTS 

In  Section  7,  we  have  seen  how  a  general  Infer¬ 
ence  rule  structure  for  data  fusion  can  be  evaluated 
through  three  different  approaches  ALDP  1-3.  In  all  of 
these,  the  key  connector  for  Inference  3  was  Inter¬ 
preted  in  the  formal  language  components  as  as 
given  In  eq -(6.14).  On  the  other  hand  a  natural  -  and 
comnonly  used  -  semantic  evaluation  for  Inference 
rules  Is  through  conditional  probabilities.  That  is, 
the  evaluation  of  a  typical  form  (j'k)j  3  ^nj)  ,s 

p(fek1 j |/k1 j)  for  some  choice  of  probability  measure 

p  over  Q,  the  set  of  all  events  or  propositions,  which 
for  purposes  of  simplicity,  from  now  on  Is  assumed  to 
be  a  boolean  algebra.  With  this  choice  of  evaluation, 
apropos  to  the  spirit  of  this  paper,  we  seek  a  formal 
language  which  will  be  compatible  with  these  evalua- 
tions.I.e.,  will  form  an  ALDP. 


Returning  to  the  data  fusion  form  In  (7.1),  the 
semantic  evaluation  for  Probability  Loqlc  becomes, 
using  first  (7.24)  and  then  (7,5). 

P(Q’4j)  ’  P(0’S  3  Hj) 

•  l  (-l)e*rd(K,M  . 

•PKsdom(Z) 


pdij  9  S^j ,  (7.31) 


which  can  be  further  evaluated  through  use  of  (7.27) 
(equality  pert)  In  conjunction  with  (7.23)-(7,26) , 


where  similar  to  (7.21),  (7.22),  but  differing  In  the 
operations  Involving  Z( , 


y  Hij-'kij  V  •  4ij 
(zi  *  *  •  \  (h  «  *  > 

Uclt  )  \kcIB 


) 


(7.32) 


and 


/  k,J  V 


(7.33) 


Alternatively,  by  using  both  (7.4)  and  (7.5)  from 
the  calculus  of  Inference  relations,  and  then  applying 
p,  one  obtains  the  sane  as  (7.20),  with *posf  replaced 
by'p"  Thus, 


P«Mj)  •  p(g(Hj;D,S)  **(Hj;D,S)).  (7.34) 

which  can  be  evaluated  through  the  equality  part  of 
(7.27)  or  through  the  expansion 


However,  as  pointed  out  In  the  discussion  In  the 
previous  section  centered  around  (7.27),  one  cannot 
identify  implication  via  (6.14)  with  conditioning 
as  evaluated  In  (7.30).  The  apparently  commonly-held 
belief  that  such  an  Identification  can  be  made  with 
no  serious  consequences,  often  called  In  the  litera¬ 
ture  of  logic  as  Stalnaker's  Thesis  [30],  was  attacked 
by  Lewis  [31]  and  independently  by  Calabrese  [32].  The 
latter  Indeed  showed, by  use  of  a  simple  canonical  ex¬ 
pansion,  that  not  only  ■*  In  (6.14)  would  not  work, 
but  any  boolean  function  of  two  variables  could  not  be 
used  to  play  the  role  of  conditioning,  compatible 
with  conditional  probability  evaluations. 

Moreover,  It  would  be  particularly  desirable,  to 
replace  this  rather  flawed  situation,  with  an  AL0P 
which  would  yield  feasible  computations  for  data 
fusion  or  at  least  be  on  the  same  order  of  complexity 
as  ALDP  1,2,3.  Note  of  course.  If  truly  all  Inference 
rule  antecedents  are  Identical ,  as  Is  the  case  es¬ 
sentially  in  Sections  4,5,6,  then  there  Is  no  real 
need  to  work  with  conditional  objects,  since  all  con¬ 
ditioned  events  can  be  simply  considered  as  uncon¬ 
ditional  ones  relative  to  their  Intersections  with  the 
fixed  cosmion  antecedent,  or  one  can  stick  with  the 
interpretation- of  Implication  as  In  (6.14).  Compatible 
with  this  result  ,  note  the  homomorphic  relations 
for  Implication  ■*  w.r.t.  disjunction  and  conjunction 
-  but  not  negation  •  as  given  In  eqs .(7.4) ,(7.5) . 

But,for  the  modeling  of  data  fusion  through  In¬ 
ference  ruies  with  varying  antecedents,  no  such  direct 
simplification  occurs  and  the  development  of  such  con¬ 
ditional  objects  would  address  the  problem.  Although 
we  have  stated  above  that  Implication  operator  ■*  for 
a  fixed  antecedent  yields  homoawrphlc  relations  for 
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v,t,  but  not  (  )',  conditional  probabilities  art  com* 
patlbla  with  homomorphic  relations  holding  for  all 
three  operations,  for  any  fixed  anteceden t , 1 .a . ,  ob- 
viously,  for  all  «0.*#.Y0  c  0  , 

p((.0w0)-)  *  i  -  p(“0i>0)  *  p(«;|t0).  (8.D 
p((«0Iy0)  V  (*0It0))  -  p(«0*  »o|yo)  *  (8-2) 
P{(0olYo,*{8o,Yo))  ■  p(a0*80lr0)  •  (83) 


Recall  also  the  operation  ♦  over  fl  ,  which  In 
teras  of  »,  •.  (  )'  Is  .for  any  «0.»0  *  o 


•  *  »  * 
O  0 


0  0  0  0 


(8.4) 


and  conversely. 


av  6 

0  0 


a  ♦  t  *  a  •# 
0  0  0  0 


(8.5) 


o' 

a 


•  ♦  1 . 


(8.6) 


Thus  there  Is  a  bfjective  relationship  between 
(Q.v.'.f  )').  a  boolean  algebra  and  (Q,+,*),  a  boolean 
ring,  (for  further  discussion  and  properties,  sae  [33]) 
Furthermore,  recall  the  Stone  Representation  Theorem 
([33].  Chapter  5)  which  establishes  an  order-preserv¬ 
ing  isomorphism  between  any  given  boolean  ring  and  a 
corresponding  boolean  ring  of  actual  subsets  of  a 
fixed  universal  set  say  X  where  the  correspondences 
hold: 

’  1  v*  X  ;♦■«-*  4  (symmetric  set  difference): 

0  •  :  v  *-»  u  (set  union): 

•  »-♦  n  (set  Intersection): 

()'**(  tr  h(  )  (set  coapleaenet) ; 

.  s  (partial  order  over  n)  *-»  &  (subset  relation) 

(8.7) 

All  following  results  can  be  Interpreted  In 
teras  of  ordinary  subsets  and  the  alternative  boolean 
algebra  or  boolean  ring  structures. 

Coting  that  also,  for  any  «0.80  e  0, 

p(°o I8q)  ‘  p(V8o,8o)  •  (8  8) 

the  next  result  shows  that  under  quite  olid  and  simple 
conditions,  conditional  objects  are  essentially  char¬ 
acterized: 

Theorea  7.  Characterization  of  conditional  objects 
-  [34] 

Given  boolean  ring  Q,  there  Is  a  unique  space 
3  of  saallest  possible  classes  -  according  to  subset 
partial  ordering-denoted  es  the  conditional  objects 

<o0IV  •  (»0Wo)-  W . for  all  vWV 

. .  c  o  ,  such  that  the  aeasure-free  counterparts  of 
(8.1 )-(8.3)  and  (8.8)  hold.  That  Is. 


(•q|r0)*  *  («ql>0)  . 

(8.9) 

(«0W0>  *  (Sqhq)  '  «V  8o,Y0)> 

(8.10) 

(“qWq)  *  (®q |Yq)  '  (<V  *0IT0)' 

(8.11) 

and  equivalent  to  (8.9)-(8.11),  one  can  require  eqs. 
(8.11)  and 

<»o'Yo>  ♦  <BJYo>  *  <V  80,To) 

(8.12) 

to  hold;  and 

(«0lT0)  '  (°o'T0!t0)- 

(8.13) 

Specifically,  such  conditional  objects 
tute  all  possible  principal  ideal  cosets  of 
where  for  any  a.y  e  fi. 

cons  ti¬ 
ring  Q, 

(“0Iy0!  *  o-y'  ♦  «0 


a"<0  *  VYo  *  *  VYo 

(x*yj  ♦  °0,Y0I*  £  W  (8.14) 


the  principal  ideal  coset  generated  by  y^  with  resl- 
due  o0. 

Proof:  Use  first  the  basic  hoaoaiorphlsm  theorea  for 
quotient  rings  and  the  equivalence  class  property 
of  cosets  applied  to  (8.13).  Again,  see  [34]. 

■ 


Thus,  for  a  fixed  antecedent,  even  though,  as 
stated  earlier  the  resulting  conditional  objects 
could  be  identified  as  subsets  or  subevents  of  the 
antecedent  (noting  Stone's  Representation  Theorea), 
nevertheless  the  actual  algebraic  structures  of 
these  entities  will  be  of  non-trivial  use:  Suppose 
we  wish  to  perform  boolean  operations  on  conditional 
objects  with  differing  antecedents:  how  can  this  be 
accoaplished,  compatible  with  the  results  in  Theorea 
7  ? 

Previous  work  in  this  direction  1ncludes:H*11- 
perin  [37],  who  extended  some  of  Boole's  original 
Ideas  and  developed  essentially  the  same  entities 
as  produced  here,  but  froa  a  different-  and  aore 
complicated-perspective,  with  relatively  little 
attention  paid  to  developing  operators  aaong  con¬ 
ditional  objects  with  different  antecedents,  using 
the  technique  of  universal  algebras  and  'partially 
deflned'operators-,  Oomotor  [36],  who  following  the 
direction  of  "»pffll Itiative  probability  structures', 
as  used  in  preference  orderings  and  subjective  proba¬ 
bility,  developed  rather  complicated  expressions 
for  containing  conditional  objects,  not  realizing  the 
rich  structure  Inherent  In  such  entities ;Adans  [39], 
aaong  others  in  the  literature,  who  considered  'con¬ 
ditional  logics*  which  appear  to  be  somewhat  related 
to  the  concept  produced  here,  hut  differ  considerably 
In  structure;  and  Calabrese  [37]  who  was  apparently 
the  first  to  attempt  to  develop  directly  conditional 
objects  froa  a  logical  consequence  viewpoint,  which 
can  be  shown  to  be  equivalent  to  that  given  here([36]. 
Section  2);but  Calabrese  proposed  ad  hoc  definitions 
for  boolean  operations  on  conditional  objects  with 
varying  antecedents. 

In  the  approach  taken  here,  developing  all  stz 
suits  froa  first  principles  considerations .  the  re¬ 
quired  operations  upon  conditional  objects  are  defin¬ 
ed  sleiply  as  the  natural  class  or  component-wise  ex¬ 
tensions  of  the  original  operations.  Thus,  for  exam¬ 
ple, let  a0t8#.T0,30  c  o  arbitrary.  The  natural  class 

extension  of  •  applied  now  to  (»0l60)  ♦  (r0l40).  not¬ 
ing  each  conditional  object  is  in  reality  via  (8.14) 
a  subset  of  a,  yields: 

(«0|80)  '  (t0!«0)  •  {<1  •  rM“0!Bo,,rt(Yo|4o)} 

’  ((*’»o  +  “qH^O  +  Yo’lvtC» 

S  0.  (8.15) 

The  basic  structure  of  the  conditional  object 
extension  3  of  fi  is  summarized  next. 

Theorea  8.  Basic  structure  of  5  [34], [35], [36], 

(I)  In  terms  of  quotient  rings, 

3  ■  u(fl/o-y')  ■  u(b/q -y  ).  (8.16) 

y0c(l  y0cQ 

(II)  Conditioning  as  defined  here  can  be  Identified 
essentially  as  the  functional  inverse  of  one-sided 
conjunction,  1  .e. ,  conditional  objects  (o  jy  )  *11  sat- 
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isfy  the  smsi  c  relation  analogous  to  (7.29)  for 
condition**,  probabilities  and  a  related  condition: 


«nd 


(“o|to,*to  *  VTo 

*  <*l*  *  “•  **7b 


«  *Y„). 

0  0 


(8.17) 

(8.18) 


(111)  The  natural  class  extensions  of  all  boolean 
operations  from  0  to  3  are  wel1-def1ne37closed  with 
ring-like  properties,!  .e..  In  the  sane  previous 
sense.  9  Is  a  nodi  fled  boolean  algebra. 

(1v)  o  S  8  . 

since  for  all  «0  c  Q.  (8.14)  shows  Inwdlately  that 


(°0|1)  *<“0>  • 


(8.19) 


(v)  Also,  partial  order  s  defined  over  a,  character¬ 
ized  by  .  'or  any  ,  tg  c  0. 

V  !o  1ff  “o  *  V»o  m  »0  *  *0  *  “o  •(8-201 

can  be  extended  directly  to  9  with  the  sane  charac¬ 
terization*  as  In  (8.20)  whera(uncond1t1ona1 )  ob¬ 
jects  In  z  are  replaced  by  conditional  ones  tn  2. 
ihen.coabt eing  this  with  (111)  and  (iv)  establishes 
(9.v.*,(  )*,♦;*)  as  a  natural  extension  of  its 
unconditional  counterpart  (o,v,-.(  )*,♦;*). 

(vl)  A  bes'c  calulus  of  operations  Is  ,  In  addition 
to  the  properties  In  (8.9)-(8.13)  for  any  aj.r,  a  0. 

1-1. ...■.  «*1 . 

v  (e, It. )  *(»•«!»  a.-T.  v  .  y,).(8.21) 

i-:  11  i-i  1  i-i  11  i-i  1 

•  '••(It.)  ■  »  •  «,  I  »  al*T(  »  •  v. )  .(8.22) 

1--  11  1-1  1  1-1  '  '  1-1  1 

!  :.,|T,)  -  (  *  0.1  "  r.)  •  (8.23) 

1--  11  1-1  ’  1-1  1 

Noting  the  reductions  of  (8.21  )-(8.23)  when 
antecedent  *,*T»*T0  .  •*  1"  (8.9)-(8.12),  It 
follows  that  all  boolean  operational  extensions 
over  a  coincide  with  corresponding  coset  operations 
whan  restricted  to  a  fixed  quotient  ring,  hare 

n/a-vj  . 

(vll)  As  a  special  case  of  (8.22),  the  following 
chaining  condition  holds  for  all  «,.*a.T0  e  a  : 


(•-/•JtJ  *  <80It0M“oI»o-to)- 


o'  0  0 


(8.24) 


Proof:  The  most  difficult  proof  Is  that  of  (8.22). 

A  sketch  e f  the  proof  for  the  ease  o*2  Is  given  In 
[35],  Theorem  3.1;  e  full  proof  Is  presented  Ip  [34] 
where  all  other  proofs  are  also  given. 

■ 

Aemarks . 

Apropos  to  Theorem  8(1),  ft  follows  that  all 
results  In  the  theory  and  application  of  linear 
(w.r.t.  •  over  v)  boolean  equations,  such  as  pre¬ 
sented  In  '40], can  be  relnterpntad  In  terns  of  con¬ 
ditional  s-sjects.  Extensions  of  the  concept  of  con¬ 
ditioning  to  wore  general  structures  than  boolean, 
such  as  Modified  boolean, or  Von  Neumann  regular,  or 
to  a  category  theory  setting, have  been  considered 
[34], 

Many  other  mathematical  properties  have  been 
derived  fer  conditional  objects,  Including:  char¬ 
acterizations  for  Iterated  conditional  objects, 1 .e. , 
conditional  objects  whose  antecedent  and  consequence 
are  also  conditional  objects;  extensions  of  Stone's 
tepresenti tlon  Theoren  to  conditional  objects;  de- 


velopaent  of  an  outer  approximation  technique  to 
force  closure  for  non-boolean  functions.  Including 
arithmetic  operations  over  conditional  objects;  rela¬ 
tions  established  between  ordinary  conditional  randoe 
variable:  and  a  randomized  version  of  conditional  ob¬ 
jects;  and  establishment  of  various  probabilistic 
connections,  suet  as  measure-free  Independence;  meas¬ 
ure-free  bayeslan  and  tequ-ntlal  learning  forms;  and 
the  proof  that  the  extension  of  any  probability 
measure  p:C  -  [0,1]  to  p:2  -  [0,1]  through  eq.(7.30) 
yields  for  the  extension  a  monotone  function^  Again, 
see  [34]-[36] ,  for  further  details.) 

Host  Importantly  here,  analogues  of  calculus  of 
relations  for  ALOP  1  (eqs.(7.2)-(7.7))  hold  for  con¬ 
ditional  objects,  as  Theorem  8  shows,  moreover,  the 
hypotheses  for  Theorem  4  all  hold  here.  At  this  point 
let  us  define  ALOP  4,  for  a  given  boolean  algebra  Q 
as  Simply 


ALOP  4  •  (5,p), 


(8.25) 


where  p:2  -  [0,1]  is  the  conditional  probability  ex¬ 
tension  of  p:R  -  [0,1],  as  mentioned  above  and  where 
Implication  Is  Interpreted  as  conditioning,  l.e.,  for 


V*„  *  0  • 


(»n  *  “o>  * 


(8.26) 


(Note  that  Implication  or  conditioning  here  Is  re¬ 
stricted  to  be  upon  unconditional  elements,  l.e.  el¬ 
ements  of  0,  not  upon  other  properly  conditional  ob¬ 
jects.  Some  results  Indicate  a  possible  Identification 
of  Iterated  conditional  forms  with  simple  conditional 
obJects([36],Section  4)  so  that  In  a  sense  this  re¬ 
striction  may  be  unnecessary.) 

finally,  consider  use  of  ALOP  4  In  evaluating 
data  fusion  expression  Q  In  (7.1): 

Direct  use  of  (8.21)  and  (8.22)  show  that 

P(2-C!J  •  P(  »  (  •  (tt.JA,,)  )  ) 

J  Z|C  doa(Z)  k-1  *1J 

■  p(alHj;D,S)|a(Hj;D.S)vq(HJ;D,S)) 

•  p(a(Kj;0,S))/p(a(Hj  ;D,S)vq(Hj  ;D,$)), 

(8.27) 

etc.,  where  q  Is  given  In  eq.(7.21)  and 

4(H,;D,S)  <  v  (  •  tSij’i'kij))-  C8-28) 

J  Z,c  dom(Z)  k-1 

Thus,  due  to  the  calculus  of  operations  given  in 
Theorem  A,  computations  for  data  fusion  using  ALDP  4, 
with  Implication  Interpreted  as  a  cendltlonlng.com- 
patlole  with  conditional  probabilities,  appears  no 
more  complex  than  that  for  the  other  choices  of  ALDP's. 

9.  CONCLUDING  DISCUSSION 


This  paper  presents  a  number  of  results  contribut¬ 
ing  toward  a  cohesive  top-down  theory  of  data  fusion. 

In  Section  1 ,  a  general  overview  of  the  data 
fusion  problem  Is  presented. with  the  conclusion  that 
data  fusion  Is  Identifiable  as  the  combination  of  evi¬ 
dence  occurring  within  decision  nodes  of  CJ  systems. 

In  Section  2,  qualitative  relations  are  established 
pinpointing  the  role  of  data  fusion  in  C3  systems-  es¬ 
pecially  as  perceived  by  the  author  In  previous  work 
(see  Figures  1,2,3),  where  data  fusion  Is  a  process 
within  a  C3  decision-maker  node  Intermediate  with 
Incoming  ’signal*  detection  and  hypotheses  selection. 
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Also,  the  concept  of  on  A10P  (algebraic  logic  des¬ 
cription  pair)  Is  Introduced  as  part  of  of  the  total 
evaluation  procedure  Involving  data  fusion  (Figure  4). 
Three  important  examples  of  ALOP's  are  given,  corres¬ 
ponding  to  Classical  Logic,  Fuzzy  Logic,  and  Probabil¬ 
ity  Logic  where  In  all, Implication  Is  Interpreted  as 
a  disjunction  of  a  negation  and  affirmation.  A  partic¬ 
ular  quantitative  counterpart  of  the  qualitative  model 
given  In  the  previous  section  Is  presented  In  Section 
3.  In  this  model,  the  collection  of  all  updated  mar¬ 
ginal  node  state  distributions  (In  either  the  classic 
probability  sense  or  In  a  multivalued  logic  sense  of 
broader  scope)  is  shown  to  depend  functionally  on  es¬ 
sentially  ten  types  of  primitive  relations  C*n  the 
probability  Interpretation,  they  become  conditional 
probabilities]  among  the  basic  variables  determining 
the  C3  system  In  question.  These  variables  Include: 

S,  *s Igna Vnodes N  rwemufj  R,  response  of  nodes;  D,de- 
tectlon  state;  H,  hypotheses  selection;  and  F,  algo¬ 
rithm  choice  (Theorem  1).  In  turn,  this  result  Is 
used  to  establish  a  zero-sum  two  person  CJ  decision 
game  between  adversary  and  friendly  C3  systems.  Therq 
each  game  move  corresponds  to  a  choice  of  the  ten 
types  of  primitive  relations,  up  to  feasible  and  com¬ 
patible  conditions,  and  the  resulting  loss  due  to  a 
joint  move  by  both  players  Is  some  flgure-of-merlt 
based  upon  moe's  and  mop’s,  which  are  In  turn  eval¬ 
uated  through  the  node  state  distributions  as  a  con¬ 
sequence  of  the  primitive  relat1ons'forms(F1gure  5). 

In  Section  4,  the  quantitative  expression  for 
data  fusion  p(H|0,S)  (eq. (4.1))  Is  considered  for  the 
classical  probability  case.  An  auxiliary  variable  Z 
Is  Introduced  for  the  evaluation,  representing  possi¬ 
ble  characteristics  or  attributes  which  can  be  used 
to  connect  D  and  S  with  H  through  probabilistic  con¬ 
ditioning  here.  This  results  In  the  well-known  weight¬ 
ed  sum  of  conditional  probabilities  form  (eq. (4 .2) } . 

In  Section  S,  two  modifications  of  the  classical  prob¬ 
ability  case  are  considered.  First  treated  Is  the 
situation  where  variables  Z  or  H  In  actuality  are 
not  random  variables  due  to  thelr'saaple  spaces  of 
elementary  events  or  domain  values  not  representing 
truly  disjoint  (and  exhaustive)  events,  but  where 
the  relevant  subfactors  contributing  to  these  -  In 
actuality,  compound  -  events  can  be  determined  at 
least  In  a  full  probabilistic  sense.  This  results, In 
effect, In  random  set  descript lorn  replacing  the 
original  "distributions"  for  the  variables  (Theorem 
2).  Next,  tha  case  where  not  all  subfactors  are 
known  Is  considered.  In  this  situation.  If  experts 
are  available,  possibility  functions  can  be  gleaned 
for  tha  overlapping  or  vague  events,  which.  In 
effect,  taka  Into  account  tha  possible  joint  occur¬ 
rences.  and  thus  can  yield  functions  which  exceed 
unity  In  suaaaatlon.  However,  It  Is  shown  In  Theorem 
3,  quite  similar  In  form  to  Theorem  2,  that  this  Is 
always  equivalent  to  the  partial  specification 
(through  one  point  coverages)  of  a  random  set  model, 
thereby  giving  rigorous  justification  for  this  pro¬ 
cedure.  The  results  In  Section  S  are  further  exten¬ 
ded  In  Section  6,  where  the  formal  language  aspect 
for  data  fusion  Is  emphasized  (Theorem  4).  This  re¬ 
sult  (extending  (4.2))  shows  data  fusion  can,  under 
relatively  mild  assumptions,  be  expressed  as  a  dis¬ 
junction  of  conjunctions  of  Inference  rules  and  var¬ 
iability  or  error  forms  connecting  0,S.  and  Z  with 
H.  In  turn,  a  general  semantic  evaluation  for  data 
fusion  Is  presented  through  t- norms .  copulas,  etc. 

(lee  (6.31jTh1$  evaluation  form  generalizes  the 
PACT  algorithm  which  seeks  to  determine  correlation 
level  between  track  histories  through  disparate  data 
sources,  Including  possible  linguistic-based  Inform¬ 
ation  [12],  A  relation  Is  given  in  Theorem  5  con¬ 
necting  the  above-mentioned  general  data  fusion 
distribution  with  random  sets  and  Oempster-Shafer 
plausibility  functions. 

In  Section  7,  the  most  general  formal  setting 
is  established  and  analyzed  for  describing  data 
fusion.  Basically  here, data  fusion  Is  considered 


-16. 


UNCLASSIFIED 


a  disjunction  of  conjunctions  of  Inference  rules  with 
antecedents  and  consequences  In  general  functional 
forms  Involving  possibly  all  four  relevant  varalbles 
D,S,Z,H  (see  eq.{7.1)),  essentially  the  same  structure 
as  a  general  knowledge-based  system,  such  as  used  In 
medical  diagnosis  or  parameter  estimation.  A  calculus 
of  operations  involving  Implications  Is  reviewed  for 
each  ALDP  and  then  applied  to  the  evaluation  of  data 
fusion  (Examples  1,2,3).  Finally,  a  fourth  ALDP  is 
determined  In  Section  8,  based  on  Interpreting  Infer¬ 
ence  rules  through  conditional  probabilities.  For  con¬ 
sistency,  this  requires  the  full  development  of  a 
calculus  of  "conditional  objects*  (Theoreaa  7,8).  It 
Is  shown  that  this  ALDP  can  be  succesfully  used  to 
evaluate  data  fusion  probabilities  with  a  level  of 
complexity  of  calculations  not  exceeding  that  of  the 
alternative  methods,  but  here  allowing  rigorously  for 
conditional  probability  Interpretations  »f  Implica¬ 
tions. 

Future  Work  and  Open  Problems 

In  this  paper  the  cognitive  process  phase  has 
been  used  only  Implicitly  In  the  evaluation  of  data 
fusion  distributions.  Future  work  will  be  directed 
toward  more  direct  use  of  mental  Imaging  and  related 
thought  processes.  This  Is  because  In  addition  to  the 
"formallstlcs*  Involved  In  translating  detected  sig¬ 
nals  (or  "signals",  using  the  more  general  sense) 
as  shown  In  the  sequence  of  processes  In  Figure  4, 
heuristic  processes  may  also  be  used,  possibly  short¬ 
ening  the  process  path  or  providing  alternative  means 
as  for  example  In  N!  (Natural  Intelligence). 

Alternative  structures  for  data  fusion  may  also 
be  Investigated  -  as  opposed  e.g.,  to  that  given  here 
In  (6.16)  or  (7.1)  In  formal  language  form.  Recursive 
computations  for  general  data  fusion  may  also  be  pos¬ 
sible,  analogous  to  the  well-known  Kalman  filter  or 
related  maximum  likelihood  forms.  In  a  similar  vein, 
progressive  change  for  hypotheses  dlstrlbutlonsbased 
upon  newly  arriving  data  may  also  be  monitored  through 
entropy  measurements.  Details  of  this  have  yet  to  be 
established  for  the  general  case  we  seek  here. 

Finally,  conditional  object  theory  must  certainly 
be  developed  further.  If  only  to  be  able  to  better 
treat  Iterated  conditioning  and  required  approxima¬ 
tions  or  truncations  of  computations  for  data  fusion 
eva luatl on- whwi Mpe through  conditional  probability 
evaluation  of  Inference  forms, i.e.,  through  ALDP  4. 
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